-- Logs begin at Fri 2022-07-29 05:14:50 UTC, end at Fri 2022-07-29 07:16:40 UTC. -- Jul 29 06:17:25.352450 dv-cinder-834822-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 06:17:25.361333 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 06:17:25 2022] *** Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: nodename: dv-cinder-834822-7-iscsi Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: machine: x86_64 Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: clock source: unix Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: pcre jit disabled Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: detected number of CPU cores: 4 Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: current working directory: / Jul 29 06:17:25.363477 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: detected binary path: /usr/bin/uwsgi-core Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: your processes number limit is 47680 Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: your memory page size is 4096 bytes Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: detected max file descriptor number: 2048 Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: lock engine: pthread robust mutexes Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: thunder lock: enabled Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 06:17:25.364164 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 06:17:25.403089 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: Python main interpreter initialized at 0x5642ff5989c0 Jul 29 06:17:25.403089 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: python threads support enabled Jul 29 06:17:25.403089 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: your server socket listen backlog is limited to 100 connections Jul 29 06:17:25.403089 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: your mercy for graceful operations on workers is 90 seconds Jul 29 06:17:25.403433 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 06:17:25.403508 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: *** Operational MODE: preforking *** Jul 29 06:17:25.403734 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: *** uWSGI is running in multiple interpreter mode *** Jul 29 06:17:25.403734 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: spawned uWSGI master process (pid: 103173) Jul 29 06:17:25.403918 dv-cinder-834822-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 06:17:25.404456 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: spawned uWSGI worker 1 (pid: 103174, cores: 1) Jul 29 06:17:25.408635 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: spawned uWSGI worker 2 (pid: 103175, cores: 1) Jul 29 06:17:25.408635 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 06:17:26.070151 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 06:17:26.080093 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 06:17:27.159501 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:17:27.159501 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: from cryptography.utils import int_from_bytes Jul 29 06:17:27.160075 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:17:27.160075 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: from cryptography.utils import int_from_bytes Jul 29 06:17:27.173980 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:17:27.173980 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: from cryptography.utils import int_from_bytes Jul 29 06:17:27.174416 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:17:27.174416 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: from cryptography.utils import int_from_bytes Jul 29 06:17:29.645099 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 06:17:29.645774 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 06:17:29.645872 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 06:17:29.646202 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 06:17:29.646453 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 06:17:29.646833 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.647159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.647473 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.647785 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.648108 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.648257 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 06:17:29.648677 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.648763 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 06:17:29.648841 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.649037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.649122 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 06:17:29.649358 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.649446 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 06:17:29.649612 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.649705 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 06:17:29.649922 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.650016 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.650243 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-7-iscsi {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.650349 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.650588 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.650684 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.650987 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.651094 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.651320 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.651414 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.651630 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.651728 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.651928 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.652028 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.652243 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.652327 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.652564 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.652669 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.652863 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.653079 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.653193 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654219 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-7-iscsi {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654362 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654362 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654574 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654663 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654742 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654742 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654880 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.654880 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655031 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655155 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655243 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655329 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655406 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655578 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655666 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.655892 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.656129 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.656241 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.656405 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.656597 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-7-iscsi {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.656744 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.656907 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.657059 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.657212 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.657396 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.657517 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.657712 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.657916 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658032 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658222 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658319 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658522 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658614 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658834 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.658926 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.659147 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.659230 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.659448 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.659610 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-7-iscsi {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.659764 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.659923 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.660076 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.660241 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.660388 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.660574 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.660732 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.660988 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.661100 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.661302 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.661398 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.661605 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.661688 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.661917 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662011 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662215 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662315 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662513 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662597 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662755 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.662848 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663056 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663147 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663369 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663452 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663682 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663775 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.663994 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664090 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664239 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664330 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664487 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664675 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664824 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.664999 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.665138 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.665306 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.665441 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.665610 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.665742 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.665862 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.666041 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.666795 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.666941 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.667141 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.667235 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.667467 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.667551 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.667767 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.667860 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.668066 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.668151 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.668357 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.668468 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.668698 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.668785 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669014 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669109 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669316 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669415 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669626 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669709 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.669936 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670021 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670245 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670337 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670546 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670641 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670859 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.670949 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.671167 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.671252 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.671468 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.671564 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.671777 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.671862 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.672090 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.672183 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.672389 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.672474 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.672715 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.672813 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673014 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673101 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673328 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673413 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673654 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673745 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.673956 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674041 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674202 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674287 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674496 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674589 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674796 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.674887 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.675114 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.675205 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.675414 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.675510 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.675713 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.675798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676013 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676097 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676306 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676404 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676625 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676762 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.676927 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677043 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677224 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677352 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677523 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677608 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677824 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.677915 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.678123 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.678208 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.678426 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.678545 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.678726 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.678825 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679025 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679129 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679336 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679445 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679648 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679743 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.679943 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680040 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680242 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680346 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680555 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680666 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680863 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.680959 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.681190 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.681282 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.681464 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.681558 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.682378 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.682531 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.682653 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.682738 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.682933 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683033 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683229 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683317 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683540 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683633 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683842 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.683929 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.684141 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.684229 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.684444 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.684557 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.684762 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.684848 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685072 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685160 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685380 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685464 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685676 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685769 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.685975 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686063 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686271 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686355 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686566 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686661 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686862 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.686959 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.687158 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.687244 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.687453 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.687546 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.687748 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.687843 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688042 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688128 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688350 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688443 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688693 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688785 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.688992 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689078 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689293 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689388 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689590 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689683 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689891 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.689975 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.690197 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.690291 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.690502 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.690587 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.690811 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.690908 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.691115 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.691209 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.691416 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.691501 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.691735 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.691821 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.692057 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.692143 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.692363 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.692447 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.692693 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.692796 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.693006 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.693163 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.693326 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.693464 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:17:29.693607 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.693749 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.693894 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.693981 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.694208 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.694297 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.694521 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.694616 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.694850 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.694935 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.695159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.695243 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.695471 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.695565 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.695786 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.695869 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.696093 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.696178 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.696405 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.696503 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.696753 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.696842 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.697070 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.697154 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.697417 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.697583 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.697728 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.697877 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698065 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698191 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698357 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698451 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698680 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698777 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.698990 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699075 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699298 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699383 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699606 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699691 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699913 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.699998 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.700233 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.700319 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.700571 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.700661 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.700885 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.700972 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.701199 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.701287 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.701506 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.701603 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.701809 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.701907 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.702116 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.702200 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.702422 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.702515 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.702729 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.702823 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703061 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703193 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703372 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703456 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703852 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.703990 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.704075 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.704300 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.704384 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.704885 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.704991 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.705195 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.705280 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.705502 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.705586 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.705802 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.705899 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.706101 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.706194 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.706402 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.706487 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.706707 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.706793 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707007 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707099 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707320 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707405 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707641 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707728 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.707943 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708036 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708256 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708339 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708582 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708822 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708912 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.708990 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.709175 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.709267 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.709479 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.709564 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.709776 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.709859 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.710082 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.710177 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.710387 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.710470 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.710683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.710777 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711003 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711112 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711308 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711610 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711706 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.711923 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712020 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712224 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712315 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712522 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712632 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712850 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.712953 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.713236 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.713792 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.713883 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.714120 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.714215 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.714436 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.714528 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.714768 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.714852 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.715086 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.715188 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.715397 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.715482 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.715712 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.715843 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.716040 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.716173 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.716368 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.716494 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.716695 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.716844 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.719471 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.719634 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.719745 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.719896 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720008 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720111 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720222 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720326 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720436 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720573 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720704 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720811 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.720922 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721025 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721126 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721227 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721328 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721429 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721543 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721543 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721838 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.721923 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722001 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722087 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722174 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722259 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722345 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722423 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722506 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722592 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722671 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722748 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722832 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722910 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.722987 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723071 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723149 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723302 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723420 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723506 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723596 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723676 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723753 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723829 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723913 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.723990 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.724108 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.724208 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.724417 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.724510 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.724752 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.724849 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725143 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725362 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725445 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725666 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725763 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.725972 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.726057 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.726287 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.726372 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.726593 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.726723 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.726907 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727018 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727325 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727535 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727655 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727839 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.727951 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.728153 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.728270 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.728453 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.729123 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.729323 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.729434 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.729662 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.729785 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.729993 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.730106 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.730305 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.730423 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.730622 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.730732 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.730930 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.731042 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.731240 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.731350 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.731546 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.731664 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732396 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732481 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732583 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732667 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732747 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732834 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732912 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.732987 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733063 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733148 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733355 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733443 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733658 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733754 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.733975 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734068 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734278 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734364 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734587 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734671 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734883 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.734968 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.735192 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.735279 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.735514 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.735599 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.735846 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.735931 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.736150 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.736249 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.736456 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.736588 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.736795 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.736895 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.737101 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.737195 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.737406 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.737491 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.737710 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.737803 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738008 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738093 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738307 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738400 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738610 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738703 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.738927 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739089 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739216 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739303 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739519 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739619 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739817 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.739910 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.740125 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.740216 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.740427 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.740525 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.740756 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.740842 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741055 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741152 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741360 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741447 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741674 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741761 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.741994 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742133 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742277 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742364 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742594 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742702 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742895 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.742985 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.743195 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.743282 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.743511 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.743596 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.743817 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.743914 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.744116 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.744248 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.745040 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.745134 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.745360 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.745457 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.745690 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.745784 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746001 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746085 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746327 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746482 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746641 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746773 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.746947 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747081 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747258 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747433 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747555 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747641 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747860 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.747945 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.748162 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.748255 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.748468 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.748573 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.748801 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.748886 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.749107 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.749195 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.749413 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.749505 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.749717 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.749803 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750020 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750106 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750324 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750471 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750642 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750778 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.750945 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751082 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751248 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751381 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751550 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751688 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751850 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.751988 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.752209 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.752350 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.752485 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.752659 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.752791 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753030 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753162 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753360 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753491 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753674 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753809 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.753990 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.754085 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.754299 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.754383 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.754611 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.754698 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.754922 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755015 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755227 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755311 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755539 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755625 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755857 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.755950 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.756164 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.756424 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.756508 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.756779 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.756866 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757088 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757174 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757390 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757475 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757691 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757777 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.757990 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758082 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758297 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758391 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758596 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758681 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758894 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.758980 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.759196 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.759292 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.759499 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.759592 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.759824 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.759921 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.760189 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.760273 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.760504 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.760706 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.760839 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761014 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761155 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761338 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761465 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761647 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761780 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.761951 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.762089 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.762256 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.762398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.762550 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.762705 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.762890 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763012 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763191 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763330 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763524 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763638 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763852 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.763937 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.764192 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.764278 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.764495 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.764611 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.764819 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.764917 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.765143 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.765229 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.765445 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.765531 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.765746 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.765839 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766053 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766149 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766359 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766444 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766664 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766757 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.766981 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767069 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767270 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767356 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767574 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767667 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767880 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.767965 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.768186 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.768278 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.768486 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.768607 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.768816 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.768903 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.769116 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.769201 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.769424 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.769517 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.769727 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.769812 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770026 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770111 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770324 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770410 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770629 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770721 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.770933 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771017 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771232 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771318 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771537 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771623 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771835 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.771920 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.772137 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.772222 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.772440 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.772583 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.772760 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.772853 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773059 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773151 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773364 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773459 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773666 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773771 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.773966 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774066 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774268 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774356 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774570 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774664 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774868 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.774964 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.775165 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.775261 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.775994 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.776105 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.776301 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.776472 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.776796 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.776886 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.777104 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.777205 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.777416 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.777502 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.777724 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.777817 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778020 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778108 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778326 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778414 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778623 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778709 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.778921 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779008 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779218 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779305 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779520 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779607 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779817 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.779905 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.780113 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.780206 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.780414 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.780606 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.780760 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.780982 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781130 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781274 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781410 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781553 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781694 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781826 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.781958 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782090 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782222 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782363 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782463 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782533 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.782961 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.783094 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.783237 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.783401 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.783537 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.783699 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.783839 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784001 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784142 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784312 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784446 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784640 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784784 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.784947 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785083 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785251 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785385 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785546 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785682 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785857 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.785992 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.786162 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.786297 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.786474 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.786620 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.786824 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.786958 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787090 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787243 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787357 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787482 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787659 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787796 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.787962 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.788109 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.788279 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.788426 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.788617 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.788760 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.788938 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.789078 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.789236 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.789391 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.789538 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.789709 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.789840 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790019 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790142 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790326 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790444 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790655 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790743 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.790972 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.791095 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.791937 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.792032 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.792323 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.792415 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.792660 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.792810 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.792968 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793056 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793274 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793359 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793581 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793675 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793888 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.793974 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.794188 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.794288 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.794499 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.794591 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.794805 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.794889 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.795104 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.795189 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.795408 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.795501 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.795707 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.795792 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796011 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796095 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796313 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796406 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796648 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796762 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.796966 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.797063 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.797280 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.797369 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.797589 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.797675 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.797920 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798013 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798232 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798318 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798537 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798621 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798842 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.798933 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.799144 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.799230 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.799453 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.799557 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.799761 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.799865 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.800174 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.800267 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.800477 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.800577 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.800803 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.800902 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.801103 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.801188 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.801408 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.801492 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.801726 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.801819 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802026 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802110 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802325 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802410 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802621 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802724 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.802940 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.803112 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.803235 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.803427 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.803551 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.803741 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.803961 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.804046 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.804266 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.804352 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.804632 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.804725 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.804967 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805052 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805285 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805370 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805590 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805676 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805897 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.805981 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.806201 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.806287 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.806523 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.806609 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.806891 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.807038 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.807225 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.807459 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.807560 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.807815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.807907 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.808137 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.808223 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.808445 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.808560 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.808791 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.808899 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.809093 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.809208 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.809414 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.809526 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.809734 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.809856 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.810047 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.810185 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.810366 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.810513 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.810776 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.810863 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.811096 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.811181 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.811402 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.811488 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.811717 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.811811 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812130 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812340 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812433 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812668 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812759 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.812982 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813082 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813282 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813386 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813584 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813670 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813904 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.813991 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.814208 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.814301 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.814517 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.814643 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.814823 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.814972 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.815129 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.815289 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.815431 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.815614 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.815731 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.815945 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816039 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816256 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816341 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816582 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816669 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816902 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.816998 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.817210 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.817296 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.817516 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.817604 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.817844 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.817942 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.818156 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.818243 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.818466 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.818552 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.818768 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.818865 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819069 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819163 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819369 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819455 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819673 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819765 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.819995 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.820086 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.820302 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.820405 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.820651 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.820742 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.820971 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821275 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821361 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821605 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821691 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821915 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.821999 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.822224 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.822332 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.822576 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.822710 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.822897 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.823163 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.823261 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.823479 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.823573 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.823783 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.823868 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.824082 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.824168 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.824382 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.824469 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.824704 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.824794 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825007 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825094 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825306 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825406 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825604 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825697 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.825901 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.826034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.826226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.826362 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.826522 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.826684 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.826839 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827001 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827144 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827320 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827444 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827628 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827744 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.827936 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.828043 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.828249 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.828380 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.828589 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.828708 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.828884 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.829035 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.829192 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.829346 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.829502 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.829916 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830059 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830239 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830366 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830545 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830671 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830868 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.830998 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.831178 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.831306 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.831488 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.831633 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.831798 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.831951 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.832108 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.832259 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.832417 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.832586 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.832756 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.832896 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833065 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833242 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833372 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833552 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833684 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833889 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.833995 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.834207 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.834291 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.834533 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.834808 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.834901 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.835130 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.835223 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.835438 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.835532 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.835745 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.835832 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.836055 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.836140 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.836363 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.836457 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.836695 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.836786 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.837003 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.837089 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.837309 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.837405 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.837616 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.837704 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.838418 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.838513 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.838763 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.838973 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.839098 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.839303 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.839409 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.839626 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.839744 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.840055 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.840141 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.840364 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.840457 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.840699 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.840804 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841012 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841108 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841363 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841454 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841673 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841770 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.841975 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842068 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842284 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842370 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842592 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842679 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842902 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.842987 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.843208 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.843329 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.843514 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.843604 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.843820 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.843906 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.844128 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.844226 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.844433 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.844521 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.844760 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.844857 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.845068 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.845162 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.845377 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.845463 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.845695 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.845781 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846025 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846119 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846341 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846427 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846655 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846741 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.846961 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.847048 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.847272 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.847358 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.847589 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.847784 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.847888 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.848092 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.848185 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.848421 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.848507 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.848766 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.848855 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.849086 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.849179 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.849399 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.849485 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.849711 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.849798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850031 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850117 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850331 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850416 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850631 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850717 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.850935 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851021 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851238 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851331 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851538 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851624 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851856 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.851949 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.852161 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.852419 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.852506 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.852765 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.852852 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.853076 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.853161 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.853420 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.853659 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.854296 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.854505 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.854620 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.854822 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.854943 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.855148 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.855274 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.855472 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.855584 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.855785 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.855880 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.856090 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.856182 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.856417 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.856503 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.856748 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.856837 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857052 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857138 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857364 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857450 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857672 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857761 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.857974 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.858115 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.858274 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.858413 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.858583 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.858847 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.858982 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.859175 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.859306 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.859480 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.859613 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.859778 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.859910 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.860095 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.860233 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.860398 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.860530 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.860727 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.860865 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861000 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861135 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861305 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861400 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861604 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861691 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861904 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.861990 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.862205 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.862292 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.862504 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.862589 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.862813 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.862912 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.863115 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.863201 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.863422 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.863520 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.863725 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.863831 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864029 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864115 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864329 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864415 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864659 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864769 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.864978 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865062 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865287 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865374 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865594 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865688 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865891 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.865983 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.866202 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.866287 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.866510 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.866603 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.866817 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.866902 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.867121 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.867213 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.867428 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.867521 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.867731 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.867823 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.868046 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.868142 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.868355 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.868600 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.868690 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.868932 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.869018 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.869274 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.869381 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.869604 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.869800 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.869934 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.870145 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.870239 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.870456 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.870543 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.870765 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.870850 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.871083 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.871176 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.871397 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.871490 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.871700 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.871786 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872006 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872101 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872314 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872400 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872646 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872737 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.872953 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.873052 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.873256 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.873524 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.873654 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.873854 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.873960 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.874156 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.874242 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.874459 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.874552 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.874763 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.874858 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.875068 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.875161 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.875372 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.875458 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.875680 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.875775 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876016 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876101 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876331 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876416 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876666 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876767 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.876981 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877066 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877290 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877382 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877594 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877680 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877898 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.877991 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.878203 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.878299 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.878507 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.878595 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.878817 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.878902 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.879129 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.879214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.879436 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.879522 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.879737 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.879824 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.880044 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.880137 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.880356 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.880456 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.880699 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.880799 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881045 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881145 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881362 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881450 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881677 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881763 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.881994 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882097 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882299 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882385 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882610 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882695 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882913 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.882999 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.883221 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.883306 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.883531 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.883661 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.883847 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.883985 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.884175 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.884260 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.884477 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.884612 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.884828 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.884922 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.885137 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.885441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.885540 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.885749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.885837 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886052 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886138 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886356 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886449 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886655 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886751 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.886960 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887046 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887258 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887344 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887556 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887643 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887855 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.887949 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.888152 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.888249 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.888454 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.888559 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.888774 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.888883 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889075 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889218 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889375 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889549 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889673 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889860 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.889973 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.890169 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.890263 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.890479 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.890564 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.890791 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.890876 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.891112 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.891199 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.891414 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.891510 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.891713 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.891817 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892010 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892096 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892326 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892410 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892658 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892761 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.892966 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.893052 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.893273 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.893358 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.893579 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.893670 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.893891 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894035 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894177 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894328 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894495 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894617 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.894911 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.895151 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.895243 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.895413 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.895500 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.895719 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.895805 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896139 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896338 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896424 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896676 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896783 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.896979 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.897064 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.897285 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.897385 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.897590 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.897677 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.897910 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898004 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898232 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898339 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898554 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898647 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898877 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.898984 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.899181 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.899268 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.899503 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.899600 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.899811 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.899905 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.900116 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.900228 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.900976 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.901105 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.901318 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.901535 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.901724 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.901862 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.901950 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.902203 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.902311 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.902513 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.902609 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.902832 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.902918 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.903137 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.903239 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.903443 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.903529 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.903761 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.903864 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.904076 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.904174 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.904399 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.904485 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.904746 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.904835 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.905054 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.905142 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.905377 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.905463 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.905695 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.905779 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906019 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906128 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906328 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906422 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906641 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906736 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.906973 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907068 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907288 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907374 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907594 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907696 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907896 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.907983 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.908135 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 06:17:29.908222 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.908504 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.908846 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.909159 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.909472 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.909790 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.910106 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.910437 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.910769 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.911082 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.911413 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.911745 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.912096 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.912414 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.912794 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.913127 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.913446 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.913759 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.914071 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:17:29.914315 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 06:17:30.062188 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Registered counter for database nova_api Jul 29 06:17:30.067212 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO dbcounter [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Registered counter for database nova_api Jul 29 06:17:30.084429 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.087443 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_db.sqlalchemy.engines [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.091221 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.094113 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writer thread running {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.147321 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.context [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5679f4af-1630-4c5a-bcc4-7bc921697664(cell1) {{(pid=103174) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 06:17:30.151272 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:17:30.151828 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.context [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5679f4af-1630-4c5a-bcc4-7bc921697664(cell1) {{(pid=103175) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 06:17:30.152890 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:17:30.153685 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:17:30.155660 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_concurrency.lockutils [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103174) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:17:30.155780 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:17:30.157402 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:17:30.157649 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Registered counter for database nova_cell0 Jul 29 06:17:30.158208 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:17:30.160181 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:17:30.162205 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO dbcounter [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Registered counter for database nova_cell0 Jul 29 06:17:30.162952 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Registered counter for database nova_cell1 Jul 29 06:17:30.168155 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO dbcounter [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Registered counter for database nova_cell1 Jul 29 06:17:30.171484 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.172873 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.174909 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_db.sqlalchemy.engines [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.176201 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.179607 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writer thread running {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.180239 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_db.sqlalchemy.engines [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.325032 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.330227 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writer thread running {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.334033 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO dbcounter [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Registered counter for database nova_cell0 Jul 29 06:17:30.339069 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO dbcounter [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Registered counter for database nova_cell0 Jul 29 06:17:30.343096 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG oslo_db.sqlalchemy.engines [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.345807 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_db.sqlalchemy.engines [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:17:30.347861 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writer thread running {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.350439 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writer thread running {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:17:30.685134 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:17:30.687913 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: WARNING keystonemiddleware.auth_token [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:17:30.692775 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:17:30.695365 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: WARNING keystonemiddleware.auth_token [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:17:31.033371 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:17:31.036642 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: WARNING keystonemiddleware.auth_token [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:17:31.039193 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: WARNING keystonemiddleware.auth_token [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:17:31.042594 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: WARNING keystonemiddleware.auth_token [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:17:31.044429 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642ff5989c0 pid: 103174 (default app) Jul 29 06:17:31.046493 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:17:31.047672 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-dcb58229-de38-4115-bae8-51b94269a7db None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001721 Jul 29 06:17:31.047807 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642ff5989c0 pid: 103175 (default app) Jul 29 06:17:31.048079 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Fri Jul 29 06:17:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:18:46.447165 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:18:46.448506 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002078 Jul 29 06:18:46.449014 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:18:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:18:46.467087 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_api:SELECT=3 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:46.468667 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_cell0:SELECT=3 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:46.469593 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_cell1:SELECT=3 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:46.470618 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:47.349047 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-1db11d31-c584-432d-97af-fbced55f4355 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:18:47.383178 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-1db11d31-c584-432d-97af-fbced55f4355 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.927048 Jul 29 06:18:47.383916 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jul 29 06:18:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:18:49.759792 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:18:49.760789 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-6737d5a8-106b-4571-86b3-d3bae3611bfd None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 29 06:18:49.761176 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 2/4] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:18:50.237569 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-1a10f6a5-81aa-47b8-9517-8661b2af9580 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "id": "c1", "ram": 256, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:50.258488 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:18:50.258488 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: warnings.warn(msg) Jul 29 06:18:50.287256 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-1a10f6a5-81aa-47b8-9517-8661b2af9580 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.519967 Jul 29 06:18:50.291760 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 3/5] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:18:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:18:50.511866 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-fcde0a5e-ec6d-405a-9467-f58ae6ebae56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:50.516300 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:18:50.516300 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: warnings.warn(msg) Jul 29 06:18:50.518996 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_api:SELECT=3 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:50.519791 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_cell0:SELECT=3 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:50.520734 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_cell1:SELECT=3 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:50.521372 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:18:50.593550 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-fcde0a5e-ec6d-405a-9467-f58ae6ebae56 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.296890 Jul 29 06:18:50.594311 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 3/6] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jul 29 06:18:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:18:52.849598 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-1a10f6a5-81aa-47b8-9517-8661b2af9580 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:18:52.850804 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-1a10f6a5-81aa-47b8-9517-8661b2af9580 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001665 Jul 29 06:18:52.851332 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 4/7] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:18:53.593682 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-0c713ad9-513c-46df-b4bc-3313b81cd3dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds512M", "disk": 5, "swap": 0, "id": "d1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:53.615762 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:18:53.615762 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: warnings.warn(msg) Jul 29 06:18:53.637972 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-0c713ad9-513c-46df-b4bc-3313b81cd3dd admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.780372 Jul 29 06:18:53.645657 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 4/8] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:18:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:18:53.655153 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-6ed3c0bb-cd17-405f-970d-355cdb347304 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:53.658073 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:18:53.658073 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: warnings.warn(msg) Jul 29 06:18:53.693624 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-6ed3c0bb-cd17-405f-970d-355cdb347304 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045507 Jul 29 06:18:53.694301 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 5/9] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jul 29 06:18:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:18:55.998236 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-0c713ad9-513c-46df-b4bc-3313b81cd3dd admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:18:55.999263 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-0c713ad9-513c-46df-b4bc-3313b81cd3dd admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jul 29 06:18:55.999659 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:18:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:18:56.407061 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-5e177231-ab74-4984-bace-31c84a3f13fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "ram": 1024}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:56.427951 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-5e177231-ab74-4984-bace-31c84a3f13fc admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422217 Jul 29 06:18:56.433958 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 6/11] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:18:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:18:56.442021 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-706c2828-6ff3-48db-97ac-f6c39c3ffc43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:56.467219 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-706c2828-6ff3-48db-97ac-f6c39c3ffc43 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028903 Jul 29 06:18:56.468205 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 6/12] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jul 29 06:18:56 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:18:58.674644 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-5e177231-ab74-4984-bace-31c84a3f13fc admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:18:58.675664 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-5e177231-ab74-4984-bace-31c84a3f13fc admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jul 29 06:18:58.676063 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 7/13] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:18:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:18:59.124801 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-88b827df-7af7-468f-b489-46d5ee89b101 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "d3", "ram": 2048, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:59.148668 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-88b827df-7af7-468f-b489-46d5ee89b101 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464956 Jul 29 06:18:59.149905 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 7/14] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:18:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:18:59.161929 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-687ee9ad-c2e1-428f-a30a-1e8160ecd3aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:18:59.194230 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-687ee9ad-c2e1-428f-a30a-1e8160ecd3aa admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035908 Jul 29 06:18:59.195476 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 8/15] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jul 29 06:18:59 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:19:01.408943 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-88b827df-7af7-468f-b489-46d5ee89b101 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:01.410507 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-88b827df-7af7-468f-b489-46d5ee89b101 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002026 Jul 29 06:19:01.411081 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 8/16] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:01.849340 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-419194d2-3292-4cb4-8bb6-f966d2e896b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "disk": 20, "ram": 4096, "swap": 0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:01.870833 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-419194d2-3292-4cb4-8bb6-f966d2e896b4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453855 Jul 29 06:19:01.871909 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 9/17] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:19:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:01.884200 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-2f45680f-2389-4c33-9bc9-960869f6b7f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:01.908633 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-2f45680f-2389-4c33-9bc9-960869f6b7f4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028722 Jul 29 06:19:01.920837 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 9/18] 10.222.0.33 () {64 vars in 1335 bytes} [Fri Jul 29 06:19:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:19:04.128051 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-419194d2-3292-4cb4-8bb6-f966d2e896b4 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:04.129104 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-419194d2-3292-4cb4-8bb6-f966d2e896b4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jul 29 06:19:04.129507 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 10/19] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:04.574939 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-1e3928d9-9165-4d46-94c9-18f3cc8c8a89 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:04.601156 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-1e3928d9-9165-4d46-94c9-18f3cc8c8a89 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.464602 Jul 29 06:19:04.601711 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 10/20] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jul 29 06:19:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:07.284983 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-419194d2-3292-4cb4-8bb6-f966d2e896b4 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:07.286033 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-419194d2-3292-4cb4-8bb6-f966d2e896b4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 Jul 29 06:19:07.286436 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 11/21] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:07.733826 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-3f8592e1-fa90-4846-95af-a2f041b2f318 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "disk": 1, "swap": 0}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:07.752932 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-3f8592e1-fa90-4846-95af-a2f041b2f318 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.458120 Jul 29 06:19:07.753512 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 11/22] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:19:07 2022] POST /compute/v2.1/flavors => generated 402 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:07.770758 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-b96e807a-9a17-474c-9b65-3edacd34c70c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:07.805982 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-b96e807a-9a17-474c-9b65-3edacd34c70c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040617 Jul 29 06:19:07.807033 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 12/23] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jul 29 06:19:07 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:19:10.006205 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-3f8592e1-fa90-4846-95af-a2f041b2f318 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:10.007152 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-3f8592e1-fa90-4846-95af-a2f041b2f318 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Jul 29 06:19:10.007555 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:10.432111 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-244e48e8-77d1-46ef-8611-7918c20c6d2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "rxtx_factor": 1.0, "id": "2"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:10.453430 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-244e48e8-77d1-46ef-8611-7918c20c6d2d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.439827 Jul 29 06:19:10.454315 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 13/25] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:19:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:10.468407 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-b24494c2-c477-4648-a911-5a0724b704a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:10.494419 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-b24494c2-c477-4648-a911-5a0724b704a9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030772 Jul 29 06:19:10.495007 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 13/26] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jul 29 06:19:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:19:12.692506 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-244e48e8-77d1-46ef-8611-7918c20c6d2d admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:12.694119 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-244e48e8-77d1-46ef-8611-7918c20c6d2d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002036 Jul 29 06:19:12.694609 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 14/27] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:13.093539 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-26a30657-fc96-495f-a490-a9f17b2e498b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:13.113831 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-26a30657-fc96-495f-a490-a9f17b2e498b admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.413131 Jul 29 06:19:13.121771 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 14/28] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:19:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:19:13.126638 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-9699b388-b96e-406e-88c0-697f33807094 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:13.151436 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-9699b388-b96e-406e-88c0-697f33807094 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028388 Jul 29 06:19:13.152019 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 15/29] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jul 29 06:19:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:19:15.411332 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-26a30657-fc96-495f-a490-a9f17b2e498b admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:15.412967 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-26a30657-fc96-495f-a490-a9f17b2e498b admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 Jul 29 06:19:15.413802 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:15.858753 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-cac8086b-b6c4-46bb-b358-ae58176bcbea admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:15.883032 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-cac8086b-b6c4-46bb-b358-ae58176bcbea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462555 Jul 29 06:19:15.883918 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 16/31] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:19:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:15.896500 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-c64de05a-c479-4c60-8f18-f938779ab47f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:15.922977 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-c64de05a-c479-4c60-8f18-f938779ab47f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030812 Jul 29 06:19:15.923780 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 16/32] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jul 29 06:19:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:19:18.160881 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-cac8086b-b6c4-46bb-b358-ae58176bcbea admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:18.166309 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-cac8086b-b6c4-46bb-b358-ae58176bcbea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002609 Jul 29 06:19:18.167059 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:18 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:18.608423 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-e9c49f88-72f4-477d-a225-c31e27e493a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "swap": 0, "name": "m1.xlarge", "ram": 16384, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 160}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:18.628500 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-e9c49f88-72f4-477d-a225-c31e27e493a9 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454915 Jul 29 06:19:18.629159 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 17/34] 10.222.0.33 () {64 vars in 1282 bytes} [Fri Jul 29 06:19:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:19:18.641328 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-8680e864-94b5-43a8-b17c-b9349ea9a3b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:18.648210 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:19:18.674555 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-8680e864-94b5-43a8-b17c-b9349ea9a3b6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031672 Jul 29 06:19:18.674555 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 18/35] 10.222.0.33 () {64 vars in 1332 bytes} [Fri Jul 29 06:19:18 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:19:38.439092 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-e9c49f88-72f4-477d-a225-c31e27e493a9 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:38.440106 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-e9c49f88-72f4-477d-a225-c31e27e493a9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 29 06:19:38.440498 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 18/36] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:19:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:38.838167 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-49f5e60c-4328-4f2c-a46f-561893c7e263 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:38.856967 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-49f5e60c-4328-4f2c-a46f-561893c7e263 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409899 Jul 29 06:19:38.857505 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 19/37] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jul 29 06:19:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:39.917762 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-e9c49f88-72f4-477d-a225-c31e27e493a9 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:39.918773 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-e9c49f88-72f4-477d-a225-c31e27e493a9 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Jul 29 06:19:39.919173 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:40.441388 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-899b198f-3448-420e-9b79-8b13e6301245 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:40.446932 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.wsgi [None req-899b198f-3448-420e-9b79-8b13e6301245 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-899b198f-3448-420e-9b79-8b13e6301245 admin admin] Request method failure captured: Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Accept: application/json Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Accept-Encoding: gzip, deflate Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Connection: keep-alive Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Content-Length: 0 Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Host: 10.222.0.33 Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Openstack-Api-Version: compute 2.90 Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Openstack-System-Scope: None Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: User-Agent: python-novaclient Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Auth-Token: gAAAAABi43v7z3Q82bBt_QRec7H0O-WWVm7CLaeEsUwjM9lLPFyje8Kq_Gje2QX-A6A1CtTPfnyl6CdQREP2RScQHYXC8H6D-93rMMzbrM4tb67dBGNWwyYZTEBbs8fudEwPBW2FOsfTFV-959qazg9Dz2RHGFk78m0IS_he0lzD2_gtDFfBBws Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Domain-Id: None Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Domain-Name: None Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Identity-Status: Confirmed Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Is-Admin-Project: True Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Domain-Id: default Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Domain-Name: Default Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Name: admin Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Role: reader,member,admin Jul 29 06:19:40.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Roles: reader,member,admin Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc5535113d8e4690869b5d23e1b0a8b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant: admin Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant-Name: admin Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User: admin Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Domain-Id: default Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Domain-Name: Default Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Id: 97726e6afd31490a96b8f997adddff27 Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Name: admin Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: method: > Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: exception: Flavor 42 could not be found. Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: action_args: {'id': '42'} Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:19:40.451790 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:40.452749 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.454692 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-899b198f-3448-420e-9b79-8b13e6301245 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:19:40.456018 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-899b198f-3448-420e-9b79-8b13e6301245 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393122 Jul 29 06:19:40.456018 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 20/39] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jul 29 06:19:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 06:19:40.462382 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-d460c40a-10be-4abb-a2fb-fd1a5b5523c3 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:40.466443 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:19:40.486145 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-d460c40a-10be-4abb-a2fb-fd1a5b5523c3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027536 Jul 29 06:19:40.486709 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 20/40] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jul 29 06:19:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:40.496579 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-f679b71e-5e73-4be6-a27c-32f936e3500c admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:40.520839 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-f679b71e-5e73-4be6-a27c-32f936e3500c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027231 Jul 29 06:19:40.521396 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 21/41] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jul 29 06:19:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:40.531389 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-79c71dc0-d4c7-4501-b230-623ef9a3c801 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:40.538678 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.wsgi [None req-79c71dc0-d4c7-4501-b230-623ef9a3c801 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-79c71dc0-d4c7-4501-b230-623ef9a3c801 admin admin] Request method failure captured: Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Accept: application/json Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Accept-Encoding: gzip, deflate Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Connection: keep-alive Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Content-Length: 0 Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Host: 10.222.0.33 Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Openstack-Api-Version: compute 2.90 Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Openstack-System-Scope: None Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: User-Agent: python-novaclient Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Auth-Token: gAAAAABi43v7z3Q82bBt_QRec7H0O-WWVm7CLaeEsUwjM9lLPFyje8Kq_Gje2QX-A6A1CtTPfnyl6CdQREP2RScQHYXC8H6D-93rMMzbrM4tb67dBGNWwyYZTEBbs8fudEwPBW2FOsfTFV-959qazg9Dz2RHGFk78m0IS_he0lzD2_gtDFfBBws Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Domain-Id: None Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Domain-Name: None Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Identity-Status: Confirmed Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Is-Admin-Project: True Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Domain-Id: default Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Domain-Name: Default Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Name: admin Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Role: reader,member,admin Jul 29 06:19:40.541928 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Roles: reader,member,admin Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc5535113d8e4690869b5d23e1b0a8b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant: admin Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant-Name: admin Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User: admin Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Domain-Id: default Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Domain-Name: Default Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Id: 97726e6afd31490a96b8f997adddff27 Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Name: admin Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: method: > Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: exception: Flavor 42 could not be found. Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: action_args: {'id': '42'} Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:19:40.543441 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:40.544373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:40.545653 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-79c71dc0-d4c7-4501-b230-623ef9a3c801 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:19:40.546829 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-79c71dc0-d4c7-4501-b230-623ef9a3c801 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016096 Jul 29 06:19:40.546829 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 21/42] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jul 29 06:19:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 06:19:41.506725 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-f679b71e-5e73-4be6-a27c-32f936e3500c admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:41.507748 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-f679b71e-5e73-4be6-a27c-32f936e3500c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 29 06:19:41.508138 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 22/43] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:42.028800 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-4156b3c2-9a73-418e-a9d0-dbc77b08ddbf admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:42.036083 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.wsgi [None req-4156b3c2-9a73-418e-a9d0-dbc77b08ddbf admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-4156b3c2-9a73-418e-a9d0-dbc77b08ddbf admin admin] Request method failure captured: Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Accept: application/json Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Accept-Encoding: gzip, deflate Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Connection: keep-alive Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Content-Length: 0 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Host: 10.222.0.33 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Openstack-Api-Version: compute 2.90 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Openstack-System-Scope: None Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: User-Agent: python-novaclient Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Auth-Token: gAAAAABi43v93Wwi06aR3AAJTSoIU3lMYRfluy4nnUe4ANzYFqoqZuSvH3_LNQQqdks9xqgMMiU9WLbchGsooRBLyMZaqwzqj-4NI7OJi3afhVdGY1BkCdR7E47_y2m2Ajvafq-2h9GgQM0Qice7PapHAc6bfzadT20CqNg7-u0jXxZcLzyZIv8 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Domain-Id: None Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Domain-Name: None Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Identity-Status: Confirmed Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Is-Admin-Project: True Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Domain-Id: default Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Domain-Name: Default Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Name: admin Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Role: reader,member,admin Jul 29 06:19:42.037622 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Roles: reader,member,admin Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc5535113d8e4690869b5d23e1b0a8b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant: admin Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant-Name: admin Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User: admin Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Domain-Id: default Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Domain-Name: Default Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Id: 97726e6afd31490a96b8f997adddff27 Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Name: admin Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: method: > Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: exception: Flavor 84 could not be found. Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: action_args: {'id': '84'} Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:19:42.039157 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:42.040087 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.041398 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-4156b3c2-9a73-418e-a9d0-dbc77b08ddbf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:19:42.042764 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-4156b3c2-9a73-418e-a9d0-dbc77b08ddbf admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391181 Jul 29 06:19:42.042764 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 22/44] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jul 29 06:19:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 06:19:42.048586 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-574ead08-03e6-47ae-a1f4-3efdb2ee2801 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:42.063672 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-574ead08-03e6-47ae-a1f4-3efdb2ee2801 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018653 Jul 29 06:19:42.064187 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 23/45] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jul 29 06:19:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:42.073957 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-74b3a2eb-5c7e-4039-997a-4d4dfb84e3c1 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:42.089051 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-74b3a2eb-5c7e-4039-997a-4d4dfb84e3c1 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018502 Jul 29 06:19:42.089578 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 23/46] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jul 29 06:19:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:19:42.098978 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-d833b31f-1dbe-419d-94fc-f81bceb68a9e admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:42.104164 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.wsgi [None req-d833b31f-1dbe-419d-94fc-f81bceb68a9e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-d833b31f-1dbe-419d-94fc-f81bceb68a9e admin admin] Request method failure captured: Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Accept: application/json Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Accept-Encoding: gzip, deflate Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Connection: keep-alive Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Content-Length: 0 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Host: 10.222.0.33 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Openstack-Api-Version: compute 2.90 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Openstack-System-Scope: None Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: User-Agent: python-novaclient Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Auth-Token: gAAAAABi43v93Wwi06aR3AAJTSoIU3lMYRfluy4nnUe4ANzYFqoqZuSvH3_LNQQqdks9xqgMMiU9WLbchGsooRBLyMZaqwzqj-4NI7OJi3afhVdGY1BkCdR7E47_y2m2Ajvafq-2h9GgQM0Qice7PapHAc6bfzadT20CqNg7-u0jXxZcLzyZIv8 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Domain-Id: None Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Domain-Name: None Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Identity-Status: Confirmed Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Is-Admin-Project: True Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Domain-Id: default Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Domain-Name: Default Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Name: admin Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Role: reader,member,admin Jul 29 06:19:42.105683 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Roles: reader,member,admin Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc5535113d8e4690869b5d23e1b0a8b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant: admin Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant-Name: admin Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User: admin Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Domain-Id: default Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Domain-Name: Default Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Id: 97726e6afd31490a96b8f997adddff27 Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Name: admin Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: method: > Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: exception: Flavor 84 could not be found. Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: action_args: {'id': '84'} Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:19:42.107214 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:42.108226 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:42.109563 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-d833b31f-1dbe-419d-94fc-f81bceb68a9e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:19:42.110876 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-d833b31f-1dbe-419d-94fc-f81bceb68a9e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011815 Jul 29 06:19:42.110876 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 24/47] 10.222.0.33 () {60 vars in 1190 bytes} [Fri Jul 29 06:19:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 06:19:43.079049 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-74b3a2eb-5c7e-4039-997a-4d4dfb84e3c1 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:43.080318 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-74b3a2eb-5c7e-4039-997a-4d4dfb84e3c1 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001718 Jul 29 06:19:43.080748 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 24/48] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:43.602829 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-6701dcb4-0a59-472a-b026-41e9384ad70d admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:43.608508 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.wsgi [None req-6701dcb4-0a59-472a-b026-41e9384ad70d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-6701dcb4-0a59-472a-b026-41e9384ad70d admin admin] Request method failure captured: Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Accept: application/json Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Accept-Encoding: gzip, deflate Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Connection: keep-alive Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Content-Length: 0 Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Host: 10.222.0.33 Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Openstack-Api-Version: compute 2.90 Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Openstack-System-Scope: None Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: User-Agent: python-novaclient Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Auth-Token: gAAAAABi43v-YXsRBMZpd5i7YrPFqfLT9ScNR6FXZHzAM5-J6CkXNPyeZIMMzF7ue53Z0CdvjcXLH1ojlevG372uonkhxfbYgPmgDS4Ogqp-yb3dvvpH1btEJJfu0rxeirp_mmO2bAJp1ScZZonw-Wy7VwLnt1S1juEF-1tvCryvBTCt-bfL4mk Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Domain-Id: None Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Domain-Name: None Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Identity-Status: Confirmed Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Is-Admin-Project: True Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Domain-Id: default Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Domain-Name: Default Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Project-Name: admin Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Role: reader,member,admin Jul 29 06:19:43.610058 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Roles: reader,member,admin Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc5535113d8e4690869b5d23e1b0a8b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant: admin Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-Tenant-Name: admin Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User: admin Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Domain-Id: default Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Domain-Name: Default Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Id: 97726e6afd31490a96b8f997adddff27 Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: X-User-Name: admin Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: method: > Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: exception: Flavor 451 could not be found. Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: action_args: {'id': '451'} Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:19:43.611825 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:43.612815 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.614037 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-6701dcb4-0a59-472a-b026-41e9384ad70d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103174) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:19:43.615273 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-6701dcb4-0a59-472a-b026-41e9384ad70d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395092 Jul 29 06:19:43.615273 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 25/49] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jul 29 06:19:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 06:19:43.621302 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-e083f55d-f6cc-47ab-89d5-032943d3d28c admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:43.636728 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-e083f55d-f6cc-47ab-89d5-032943d3d28c admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018903 Jul 29 06:19:43.637268 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 25/50] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jul 29 06:19:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:43.648002 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:43.663722 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020260 Jul 29 06:19:43.664244 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 26/51] 10.222.0.33 () {60 vars in 1210 bytes} [Fri Jul 29 06:19:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:19:43.673644 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-f1512141-7788-4755-8564-05fefee510f3 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:43.679475 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.wsgi [None req-f1512141-7788-4755-8564-05fefee510f3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-f1512141-7788-4755-8564-05fefee510f3 admin admin] Request method failure captured: Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Accept: application/json Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Accept-Encoding: gzip, deflate Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Connection: keep-alive Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Content-Length: 0 Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Host: 10.222.0.33 Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Openstack-Api-Version: compute 2.90 Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Openstack-System-Scope: None Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: User-Agent: python-novaclient Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Auth-Token: gAAAAABi43v-YXsRBMZpd5i7YrPFqfLT9ScNR6FXZHzAM5-J6CkXNPyeZIMMzF7ue53Z0CdvjcXLH1ojlevG372uonkhxfbYgPmgDS4Ogqp-yb3dvvpH1btEJJfu0rxeirp_mmO2bAJp1ScZZonw-Wy7VwLnt1S1juEF-1tvCryvBTCt-bfL4mk Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Domain-Id: None Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Domain-Name: None Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Identity-Status: Confirmed Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Is-Admin-Project: True Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Domain-Id: default Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Domain-Name: Default Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Project-Name: admin Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Role: reader,member,admin Jul 29 06:19:43.681034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Roles: reader,member,admin Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cc5535113d8e4690869b5d23e1b0a8b2", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cc5535113d8e4690869b5d23e1b0a8b2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant: admin Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant-Id: cc5535113d8e4690869b5d23e1b0a8b2 Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-Tenant-Name: admin Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User: admin Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Domain-Id: default Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Domain-Name: Default Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Id: 97726e6afd31490a96b8f997adddff27 Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: X-User-Name: admin Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: method: > Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: exception: Flavor 451 could not be found. Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: action_args: {'id': '451'} Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:19:43.682596 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:43.683528 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: ERROR nova.api.openstack.wsgi Jul 29 06:19:43.684798 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-f1512141-7788-4755-8564-05fefee510f3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103175) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:19:43.686034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-f1512141-7788-4755-8564-05fefee510f3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012359 Jul 29 06:19:43.686034 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 26/52] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jul 29 06:19:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 06:19:44.643342 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:44.644336 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 29 06:19:44.644791 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 27/53] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:45.162916 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-c324f828-a8d7-4172-a94c-9a374bde847f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:45.181792 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-c324f828-a8d7-4172-a94c-9a374bde847f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399747 Jul 29 06:19:45.182349 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 27/54] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jul 29 06:19:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:46.168378 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:46.169418 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 29 06:19:46.169822 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:46.685276 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-f4315f38-ef12-4029-a7e1-8a01c77348e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:46.704038 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-f4315f38-ef12-4029-a7e1-8a01c77348e4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.396498 Jul 29 06:19:46.704879 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 28/56] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jul 29 06:19:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:47.672765 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:47.673778 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 29 06:19:47.674182 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 29/57] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:48.195411 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-f55b6308-ec63-42a1-a000-0281b3bc01ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:48.214102 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-f55b6308-ec63-42a1-a000-0281b3bc01ac admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.401093 Jul 29 06:19:48.214645 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 29/58] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jul 29 06:19:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:49.181449 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:49.182446 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jul 29 06:19:49.182841 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 30/59] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:49.705154 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-5b726a05-c7a1-477e-834c-9d4115ac5b44 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:19:49.724366 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-5b726a05-c7a1-477e-834c-9d4115ac5b44 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.401951 Jul 29 06:19:49.724966 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 30/60] 10.222.0.33 () {64 vars in 1235 bytes} [Fri Jul 29 06:19:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:19:50.696557 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:50.697558 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 29 06:19:50.697953 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 31/61] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:19:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:19:51.228731 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-bbe1b8a3-6357-44f1-afea-0855fe0e1a9e admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:19:51.249366 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-bbe1b8a3-6357-44f1-afea-0855fe0e1a9e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.412107 Jul 29 06:19:51.249901 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 31/62] 10.222.0.33 () {60 vars in 1202 bytes} [Fri Jul 29 06:19:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:20:43.222937 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:20:43.223936 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-57fbac16-0fe1-473a-a6ed-0051900346d3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jul 29 06:20:43.224335 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 32/63] 10.222.0.33 () {54 vars in 930 bytes} [Fri Jul 29 06:20:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:20:43.234565 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:20:43.616774 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-b87d6f1c-9155-4f0c-85d6-6f06b350c171 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:20:43.636652 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-b87d6f1c-9155-4f0c-85d6-6f06b350c171 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406425 Jul 29 06:20:43.637119 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 32/64] 10.222.0.33 () {60 vars in 1291 bytes} [Fri Jul 29 06:20:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:20:43.657856 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG dbcounter [-] [103174] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:20:43.662458 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-6e8f0dc3-ec93-4495-b6a1-e98e1efedffb admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:20:43.670941 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-6e8f0dc3-ec93-4495-b6a1-e98e1efedffb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014514 Jul 29 06:20:43.671457 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 33/65] 10.222.0.33 () {60 vars in 1282 bytes} [Fri Jul 29 06:20:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:20:43.682942 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-08c1bf9b-afd3-4441-85ec-141233db8cb3 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:20:43.690463 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-08c1bf9b-afd3-4441-85ec-141233db8cb3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011079 Jul 29 06:20:43.691463 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 33/66] 10.222.0.33 () {60 vars in 1285 bytes} [Fri Jul 29 06:20:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:20:43.702854 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:20:43.711768 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012988 Jul 29 06:20:43.712275 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 34/67] 10.222.0.33 () {60 vars in 1285 bytes} [Fri Jul 29 06:20:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:20:43.723574 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-d3dab516-6eca-4c0e-8460-d5dd7d0934c8 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:20:43.731541 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-d3dab516-6eca-4c0e-8460-d5dd7d0934c8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011637 Jul 29 06:20:43.732612 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 34/68] 10.222.0.33 () {60 vars in 1282 bytes} [Fri Jul 29 06:20:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:24:25.727973 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:25.729025 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 29 06:24:25.729589 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:24:25.876836 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_api:SELECT=6 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:24:26.044454 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-36dc207f-9921-492b-bc80-64481a3a6a20 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:26.046828 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:24:26.046828 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: warnings.warn(msg) Jul 29 06:24:26.048030 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-36dc207f-9921-492b-bc80-64481a3a6a20 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:26.048466 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-36dc207f-9921-492b-bc80-64481a3a6a20 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:26.049262 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-36dc207f-9921-492b-bc80-64481a3a6a20 admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:26.049683 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-36dc207f-9921-492b-bc80-64481a3a6a20 admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:26.084129 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-36dc207f-9921-492b-bc80-64481a3a6a20 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208782 Jul 29 06:24:26.084905 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 35/70] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jul 29 06:24:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:24:26.915253 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:26.916291 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 29 06:24:26.916739 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:24:27.116164 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-35dfc443-7f41-4e23-912f-1456a6b3a594 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:27.118717 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:24:27.118717 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: warnings.warn(msg) Jul 29 06:24:27.119923 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-35dfc443-7f41-4e23-912f-1456a6b3a594 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:27.120364 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-35dfc443-7f41-4e23-912f-1456a6b3a594 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:27.121184 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-35dfc443-7f41-4e23-912f-1456a6b3a594 admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:27.121607 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-35dfc443-7f41-4e23-912f-1456a6b3a594 admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:27.142045 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-35dfc443-7f41-4e23-912f-1456a6b3a594 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085894 Jul 29 06:24:27.142611 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 36/72] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jul 29 06:24:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:24:38.395384 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:38.396388 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Jul 29 06:24:38.396823 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 37/73] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:24:38.540660 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_cell0:SELECT=4 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:24:38.541305 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_cell1:SELECT=4 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:24:38.541915 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG dbcounter [-] [103175] Writing DB stats nova_api:SELECT=8 {{(pid=103175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:24:38.590680 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-749f80e6-1e3b-4652-b1ca-d1c4e1b7619d admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:38.593072 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:24:38.593072 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: warnings.warn(msg) Jul 29 06:24:38.594311 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-749f80e6-1e3b-4652-b1ca-d1c4e1b7619d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:38.594756 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-749f80e6-1e3b-4652-b1ca-d1c4e1b7619d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:38.595599 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-749f80e6-1e3b-4652-b1ca-d1c4e1b7619d admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:38.596032 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-749f80e6-1e3b-4652-b1ca-d1c4e1b7619d admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:38.621711 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-749f80e6-1e3b-4652-b1ca-d1c4e1b7619d admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085613 Jul 29 06:24:38.622257 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 37/74] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jul 29 06:24:38 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:24:39.446160 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: DEBUG nova.api.openstack.wsgi [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] Calling method '>' {{(pid=103174) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:39.447164 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: INFO nova.api.openstack.requestlog [None req-160901b6-c99c-4981-8acd-bc504df64cb3 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 29 06:24:39.447558 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: [pid: 103174|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1074 bytes} [Fri Jul 29 06:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:24:39.635291 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG nova.api.openstack.wsgi [None req-f72fe7e4-846e-48d1-891a-ac8e1764bb11 admin admin] Calling method '>' {{(pid=103175) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:24:39.637747 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 06:24:39.637747 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: warnings.warn(msg) Jul 29 06:24:39.638940 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-f72fe7e4-846e-48d1-891a-ac8e1764bb11 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:39.639373 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-f72fe7e4-846e-48d1-891a-ac8e1764bb11 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:39.640150 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-f72fe7e4-846e-48d1-891a-ac8e1764bb11 admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:24:39.640592 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: DEBUG oslo_concurrency.lockutils [None req-f72fe7e4-846e-48d1-891a-ac8e1764bb11 admin admin] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103175) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:24:39.662524 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: INFO nova.api.openstack.requestlog [None req-f72fe7e4-846e-48d1-891a-ac8e1764bb11 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078410 Jul 29 06:24:39.662992 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: [pid: 103175|app: 0|req: 38/76] 10.222.0.33 () {60 vars in 1193 bytes} [Fri Jul 29 06:24:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:25:35.482576 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: Fri Jul 29 06:25:35 2022 - graceful shutdown triggered... Jul 29 06:25:35.483247 dv-cinder-834822-7-iscsi devstack@n-api.service[103175]: Gracefully killing worker 2 (pid: 103175)... Jul 29 06:25:35.483639 dv-cinder-834822-7-iscsi devstack@n-api.service[103174]: Gracefully killing worker 1 (pid: 103174)... Jul 29 06:25:35.484266 dv-cinder-834822-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 06:25:36.484356 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: worker 1 buried after 1 seconds Jul 29 06:25:36.484943 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: worker 2 buried after 1 seconds Jul 29 06:25:36.484943 dv-cinder-834822-7-iscsi devstack@n-api.service[103173]: goodbye to uWSGI. Jul 29 06:25:36.486338 dv-cinder-834822-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 06:25:36.486988 dv-cinder-834822-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 06:25:36.490169 dv-cinder-834822-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 06:25:36.501443 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 06:25:36 2022] *** Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: nodename: dv-cinder-834822-7-iscsi Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: machine: x86_64 Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: clock source: unix Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: pcre jit disabled Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: detected number of CPU cores: 4 Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: current working directory: / Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: detected binary path: /usr/bin/uwsgi-core Jul 29 06:25:36.503594 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: your processes number limit is 47680 Jul 29 06:25:36.504459 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: your memory page size is 4096 bytes Jul 29 06:25:36.504459 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: detected max file descriptor number: 2048 Jul 29 06:25:36.504459 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: lock engine: pthread robust mutexes Jul 29 06:25:36.504459 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: thunder lock: enabled Jul 29 06:25:36.504459 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 06:25:36.504459 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 06:25:36.545221 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: Python main interpreter initialized at 0x564d94c919c0 Jul 29 06:25:36.545221 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: python threads support enabled Jul 29 06:25:36.545221 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: your server socket listen backlog is limited to 100 connections Jul 29 06:25:36.545221 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: your mercy for graceful operations on workers is 90 seconds Jul 29 06:25:36.545638 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 06:25:36.545638 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: *** Operational MODE: preforking *** Jul 29 06:25:36.545854 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: *** uWSGI is running in multiple interpreter mode *** Jul 29 06:25:36.545854 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: spawned uWSGI master process (pid: 117941) Jul 29 06:25:36.546063 dv-cinder-834822-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 06:25:36.546634 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: spawned uWSGI worker 1 (pid: 117957, cores: 1) Jul 29 06:25:36.552625 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: spawned uWSGI worker 2 (pid: 117958, cores: 1) Jul 29 06:25:36.552625 dv-cinder-834822-7-iscsi devstack@n-api.service[117941]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 06:25:37.204192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 06:25:37.204837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 06:25:38.366509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:25:38.366509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: from cryptography.utils import int_from_bytes Jul 29 06:25:38.367643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:25:38.367643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: from cryptography.utils import int_from_bytes Jul 29 06:25:38.374939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:25:38.374939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: from cryptography.utils import int_from_bytes Jul 29 06:25:38.375480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 06:25:38.375480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: from cryptography.utils import int_from_bytes Jul 29 06:25:40.818635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 06:25:40.819215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 06:25:40.819312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 06:25:40.819312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 06:25:40.819742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 06:25:40.819825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 06:25:40.819911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 06:25:40.819991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 06:25:40.820061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 06:25:40.820364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 06:25:40.820476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.820695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.820796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.820993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.821106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.821317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.821423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.821638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.821745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.821953 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.822057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.822262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.822370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.822582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.822694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.822904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.823932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-7-iscsi {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.824099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-834822-7-iscsi {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.824277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.824424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.824604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.824881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.825071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.825234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.825393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.825540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.825713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.825874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.826018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.826177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.826339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.826507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.826662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.826882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.827195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.827501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.827812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.828155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.828466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.828668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.828833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.829105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.829272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.829425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.829706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.829885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.830040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.830322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.830498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-7-iscsi {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.831330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.831506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.831656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.831956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.832138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.832370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.832586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.833016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.833264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.833424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.833642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.833815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.833963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.834121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.834290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.834620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.834794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-834822-7-iscsi {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.834972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.835136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.835292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.835445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.835598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.835755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.835908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.836070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.836217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.836372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.836524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.836725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.836882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.837048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.837222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.837381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.837552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.837718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.837917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.838074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.838263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.838421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.838596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.838755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.838910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.839080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.839080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.839365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.840987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.841217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.841383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.841680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.841854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.842037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.842288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.842456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.842614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.842767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.842919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.843072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.843229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.843428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.843593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.843759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.843916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.844071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.844237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.844392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.844577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.844814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.844972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.845129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.845289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.845445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.845445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.845749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.845749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.846042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.846195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.846418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.846576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.846729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.846885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.847973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.848126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.848279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.848279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.848952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.848952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.849268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.849593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.850315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.850481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.850654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.850808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.850961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.851108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.851259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.851259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.851656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.851804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.851955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.852101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.852246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.852519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.852757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.852923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.853069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.853225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.853377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.853586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.853735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.853888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.854034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.854187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.854332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.854498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.854653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.854825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.855979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.856124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.856277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.856432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.856598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.856769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.856922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.857086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.857232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.857387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.857539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.857706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.857860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.858920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.859071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.859216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.859368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.859523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.859677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.859849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.860429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.860711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.860865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.861032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.861186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.861339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.861499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.861645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.861790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.862449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.862699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.862852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.862997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.863154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.863313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.863465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.863660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.863806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.863966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.864124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.864269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.864425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.864425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.864764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.864917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.865081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.865311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.865461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.865606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.866341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.866501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.866649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.866813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.866960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.867106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.867262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.867409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.867561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.867711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.867865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.868019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.868179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.868334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.868481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.869194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.869366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.869535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.869683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.869836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.869993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.870573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.870752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.870999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.871160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.871307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.871455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.871608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.871771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.871931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.872078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.872232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.872399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.872574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.872745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.872997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.873149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.873309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.873464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.873666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.873896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.874061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.874208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 06:25:40.874370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.874531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.874678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.874833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.874979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.875123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.875298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.875530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.875682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.875838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.876130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.876130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.876451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.876629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.876796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.876796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.877104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.877104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.877387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.877387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.878247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.878396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.878560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.878718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.878865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.879764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.880203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.880815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.881002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.881266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.881427 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.881584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.881740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.881901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.882987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.883240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.883240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.883531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.883734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.883887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.884034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.884179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.884334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.884489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.884725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.884874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.885028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.885028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.885028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.885464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.885711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.885868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.886933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.888830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.889274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.889441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.889595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.889742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.889895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.890056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.890201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.890348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.890510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.891107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.891289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.891539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.891698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.891864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.892968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.893175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.893497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.893663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.893924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.894088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.894253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.894407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.894569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.894716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.894868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.895015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.895161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.895316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.895468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.895616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.895856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.896976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.897121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.897121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.897420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.897775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.897938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.898094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.898248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.898407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.898565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.898719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.898872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.899913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.900073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.900073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.900370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.900515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.900700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.901263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.901420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.901601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.901837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.902989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.903144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.903376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.903625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.903778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.903967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.904126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.904280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.904437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.904632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.904786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.904932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.905091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.905255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.905417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.905562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.905707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.905871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.906090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.906248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.906408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.906736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.906896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.907972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.908129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.908295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.908442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.908605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.908805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.909057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.909322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.909831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.910004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.910154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.910385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.910538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.910757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.911446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.911611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.911760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.912026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.912190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.912347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.912511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.912717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.912966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.913138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.913295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.913453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.913631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.913631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.914143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.914299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.914446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.914602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.914761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.914907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.915993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.916225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.916387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.917225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.917391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.917549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.917701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.917860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.918953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.919100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.919247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.919399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.919545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.919698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.919854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.920998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.921572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.921730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.921885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.922064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.922299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.922469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.922624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.922771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.922924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.923092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.923263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.923416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.924851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.925039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.925039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.925519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.925674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.925831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.926229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.926461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.926625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.926774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.926921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.927079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.927226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.927419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.927575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.927730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.927884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.928060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.928233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.928381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.928564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.928736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.928891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.929993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.930169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.930331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.930484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.930643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.930806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.930959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.931119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.931759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.931932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.932095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.932261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.932604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.932769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.932945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.933099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.933252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.933420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.933420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.933420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.933929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.934108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.934413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.934590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.934753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.934906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.935068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.935231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.935400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.935553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.935707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.935858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.936018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.936171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.936338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.936615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.936777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.936930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.937971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.938592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.938837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.938994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.939886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.940031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.940640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.940741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.940837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.940923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.941017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.941109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.941214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.941312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.941870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.941991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.942958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.943935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.944967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.945916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.946941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.947998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.948844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.949992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.950979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.951711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.952948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.953938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954209 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.954995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.955959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.956962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.957919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.958962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.959950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.960952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.961902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.962946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.963940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.964901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.965930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.966105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.966241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.966498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.966720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.966842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.966953 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.967123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.967229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.967432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.967535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.967737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.967829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.968041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.968142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.968345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.968445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.968787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.969110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.969425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.969680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.969770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.970014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.970133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.970346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.970454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.970680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.970777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.971006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.971108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.971367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.971524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.971703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.972163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.972445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.972574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.972777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.972904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.973081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.973233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.973386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.973558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.973706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.973881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.974008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.974195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.974327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.974508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.974741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.974835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.975049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.975149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.975355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.975456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.975768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.975881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.976094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.976187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.976384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.976490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.976801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.976941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.977955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.978982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.979198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.979301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.979511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.979605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.979813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.979914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.980123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.980216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.980437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.980532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.980773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.980878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.981081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.981182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.981409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.981503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.981722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.981822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.982966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.983061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.983276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.983378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.983585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.983717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.983889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.984997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.985151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.985312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.985467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.985634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.985787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.985958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.986055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.986247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.986351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.986657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.986749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.987588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.987959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.988065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.988292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.988394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.988649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.988762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.988966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.989090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.989283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.989381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.989604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.989708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.989925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.990934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.991164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.991312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.991475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.991568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.991791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.991893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.992118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.992220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.992445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.992568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.992779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.992883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.993114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.993266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.993445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.993582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.993764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.993898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.994081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.994224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.994404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.994550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.994707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.994877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.995915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.996142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.996244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.996469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.996594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.996810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.996918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.997109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.997213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.997408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.997641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.997779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.997879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.998947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.999086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.999250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.999416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.999551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.999733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:40.999892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.000059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.000195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.000390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.000527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.000735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.000870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.001979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.002137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.002307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.002538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.003453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.003659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.003763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.003997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.004092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.004351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.004464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.005816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.006979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.007202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.007302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.007516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.007665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.007884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.008874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.009094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.009202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.009408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.009510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.009720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.009815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.010033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.010136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.010362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.010468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.010684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.010786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.011977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.012073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.012295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.012395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.012648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.012804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.012959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.013996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.014210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.014303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.014518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.014626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.014829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.014930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.015133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.015234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.015439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.015545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.015746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.015842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.016055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.016149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.016367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.016532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.016706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.016812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.017021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.017121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.017329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.017437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.017638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.017780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.018010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.018164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.018320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.018636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.018869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.018976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.019191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.019463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.019572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.019780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.019873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.020113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.020208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.020438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.020570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.020788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.020884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.021105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.021210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.021422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.021525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.021749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.021851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.022987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.023102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.023288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.023384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.023607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.023699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.023915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.024008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.024219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.024314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.024569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.024680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.024872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.025120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.025407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.025511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.025759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.025860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.026076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.026225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.026394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.026489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.026714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.026818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.027953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.028069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.028259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.028368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.028590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.028691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.028906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.029914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.030128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.030221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.030429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.030522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.030740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.030835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.031979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.032073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.032280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.032383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.032680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.032831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.032987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.033086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.033293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.033429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.033598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.033747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.033931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.034236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.034485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.034596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.034819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.034916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.035127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.035227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.035438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.035544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.035743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.035838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.036051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.036154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.036411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.036508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.036756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.036860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.037061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.037166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.037364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.037459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.037680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.037826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.038078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.038213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.038463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.038569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.038697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.038857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.039007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.039190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.039349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.039521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.039666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.039847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.040170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.040276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.040504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.040620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.040841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.041108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.041218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.041443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.041585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.041776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.041878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.042119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.042225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.042450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.042552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.042766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.042860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.043075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.043196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.043401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.043616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.043708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.043801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.044035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.044241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.044344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.044620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.044722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.044945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.045987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.046198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.046300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.046509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.046608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.046817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047546 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.047871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.048062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.048145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.048396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.048564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.048759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.048855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.049072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.049165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.049930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.050097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.050242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.050590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.050769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.050866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.051089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.051193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.051425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.051528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.051740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.051835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.052051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.052154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.052361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.052455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.052702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.052814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.053110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.053432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.053540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.053753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.053871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.054068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.054169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.054389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.054490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.054711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.054820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.055962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.056070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.056274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.056377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.056610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.056731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.056972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.057080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.057283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.057398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.057594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.057702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.057897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.058928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.059138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.059242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.059439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.059533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.059748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.059850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.060040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.060181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.060346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.060673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.060789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.060981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.061075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.061289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.061390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.061590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.061718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.061893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.062991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.063105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.063322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.063425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.063640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.063760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.063958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.064073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.064271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.064382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.064590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.064689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.064895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.065551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.065750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.066086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.066320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.066415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.066644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.066739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.066964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.067059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.067285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.067395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.067607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.067720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.067921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.068016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.068236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.068368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.068574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.068773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.068884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.069910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.070127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.070229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.070436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.070540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.070746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.070840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.071056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.071157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.071381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.071488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.071706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.071801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.072993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.073088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.073301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.073432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.073610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.073732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.073938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.074971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.075178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.075276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.075488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.075596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.075802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.075910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.076111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.076212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.076425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.076522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.076764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.076873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.077079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.077173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.077407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.077507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.077732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.077837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.078040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.078363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.078493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.078688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.078824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.079965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.080059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.080274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.080368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.080664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.080810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.080980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.081145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.081310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117958) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 06:25:41.081511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.081829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.082155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.082470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.083031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.083339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.083646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.083955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.084264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.084594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.084909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.085218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.085526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.085833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.086140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.086446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.086779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.087115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.087436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.087764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.088078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.088404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.088740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.089066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.089391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.089709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.090031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.090371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.090690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.091007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.091320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.091634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.091950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.092264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.092616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.092950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.093261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.093587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.093912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.094239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.094560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.094876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.095212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.095526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.095843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.096172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.097060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.097390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.097720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.098040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.098358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.098684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.099010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.099347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.099677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.099993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.100330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.100701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.101058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.101378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.101726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.102059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.102376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.102692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.103000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 06:25:41.103247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117957) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 06:25:41.142395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Registered counter for database nova_api Jul 29 06:25:41.162519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.166829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO dbcounter [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Registered counter for database nova_api Jul 29 06:25:41.169172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.188025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_db.sqlalchemy.engines [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.195727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writer thread running {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.225549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.context [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5679f4af-1630-4c5a-bcc4-7bc921697664(cell1) {{(pid=117958) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 06:25:41.229698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:25:41.231269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:25:41.232063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:25:41.234075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:25:41.236049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Registered counter for database nova_cell0 Jul 29 06:25:41.240764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Registered counter for database nova_cell1 Jul 29 06:25:41.247909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.250179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.253129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.context [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5679f4af-1630-4c5a-bcc4-7bc921697664(cell1) {{(pid=117957) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 06:25:41.256907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.257595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:25:41.258932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.259189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:25:41.260001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:25:41.262055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:25:41.264057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO dbcounter [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Registered counter for database nova_cell0 Jul 29 06:25:41.268239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO dbcounter [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Registered counter for database nova_cell1 Jul 29 06:25:41.278618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_db.sqlalchemy.engines [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.279497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_db.sqlalchemy.engines [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.288276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writer thread running {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.288662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writer thread running {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.405375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO dbcounter [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Registered counter for database nova_cell0 Jul 29 06:25:41.412471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_db.sqlalchemy.engines [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117958) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.417064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writer thread running {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.439731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO dbcounter [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Registered counter for database nova_cell0 Jul 29 06:25:41.448334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_db.sqlalchemy.engines [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117957) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 06:25:41.453873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writer thread running {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 06:25:41.732577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:25:41.739726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:25:41.772649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: WARNING keystonemiddleware.auth_token [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:25:41.780165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: WARNING keystonemiddleware.auth_token [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:25:42.081105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:25:42.087308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: WARNING keystonemiddleware.auth_token [None req-1d636ef2-f1ec-4021-aa80-532652f3be9f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:25:42.092607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d94c919c0 pid: 117958 (default app) Jul 29 06:25:42.126242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: WARNING keystonemiddleware.auth_token [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 06:25:42.132262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: WARNING keystonemiddleware.auth_token [None req-9ba6cd36-eb80-4b9c-8632-871b10c644cf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 06:25:42.137566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564d94c919c0 pid: 117957 (default app) Jul 29 06:26:23.059612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.061161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.063327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.065976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.980077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.980077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.991493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:23.993094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:24.874516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5eb0daa1-fafd-4692-808e-73db29fceda0 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Action: 'create', calling method: .version_select at 0x7f145bb0cee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-578699675", "metadata": {"Type": "work"}}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:25.676292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-782e11c1-df75-40fc-9f78-8e2f61e52694 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Action: 'create', calling method: .version_select at 0x7f145bae5ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1556993601"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:27.570193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5eb0daa1-fafd-4692-808e-73db29fceda0 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.526897 Jul 29 06:26:27.583795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Jul 29 06:26:23 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4543 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 29 06:26:27.614770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-080143c9-24ba-4054-9a10-e3eeca3631c6 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8edd30>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:27.806587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-080143c9-24ba-4054-9a10-e3eeca3631c6 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 200 len: 352 microversion: 2.1 time: 0.220324 Jul 29 06:26:27.807583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 2/2] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:27 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 352 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:28.261981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-782e11c1-df75-40fc-9f78-8e2f61e52694 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.290754 Jul 29 06:26:28.263335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1155 bytes} [Fri Jul 29 06:26:23 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4295 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 29 06:26:28.278924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7649aec8-cd52-4630-a471-7f5cee0fbaba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8fe430>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:28.585373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7649aec8-cd52-4630-a471-7f5cee0fbaba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 200 len: 346 microversion: 2.1 time: 0.310299 Jul 29 06:26:28.586368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 3/4] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:28 2022] GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 346 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:28.600328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-59fc0481-9d96-4f03-a11a-6617b5aa556a tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Action: 'create', calling method: .version_select at 0x7f145b8efca0>, body: {"snapshot": {"volume_id": "f9dff889-7597-4d15-bd61-4bc2e9e7cd90", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2033916174"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:28.821278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4ad85399-c52d-487e-a1aa-16f55bef73f5 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8feb80>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:28.944659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4ad85399-c52d-487e-a1aa-16f55bef73f5 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 200 len: 353 microversion: 2.1 time: 0.127532 Jul 29 06:26:28.954202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 4/5] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:28 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:28.959541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5068be42-6131-49b1-bb46-d665ce25a8c6 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8fed30>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:29.033694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5068be42-6131-49b1-bb46-d665ce25a8c6 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 200 len: 353 microversion: 2.1 time: 0.076366 Jul 29 06:26:29.037241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 5/6] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:28 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:29.062615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73134ae4-6992-4486-b46c-e58b9cc73537 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8fe4c0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:29.318775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-59fc0481-9d96-4f03-a11a-6617b5aa556a tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.722624 Jul 29 06:26:29.321517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 2/7] 10.222.0.33 () {60 vars in 1162 bytes} [Fri Jul 29 06:26:28 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:29.332449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-29af716b-ebac-4369-8748-d901209466cc tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8feee0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:29.408275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-29af716b-ebac-4369-8748-d901209466cc tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 200 len: 287 microversion: 2.1 time: 0.079706 Jul 29 06:26:29.415192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 3/8] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:29 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:29.427685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8cc79005-f5a5-4218-8f0c-e7430501b78d tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905550>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:29.525802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73134ae4-6992-4486-b46c-e58b9cc73537 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 202 len: 0 microversion: 2.1 time: 0.470409 Jul 29 06:26:29.527266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 6/9] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:26:29 2022] DELETE /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:26:29.537907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ffc2f5e6-7e29-4024-946c-9353cbdb9d46 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8edee0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:29.596284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8cc79005-f5a5-4218-8f0c-e7430501b78d tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.179414 Jul 29 06:26:29.597288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 4/10] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Jul 29 06:26:29 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:29.614356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4559be9d-b7a2-4757-ab5f-873c22e18d91 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8fe1f0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:29.716267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ffc2f5e6-7e29-4024-946c-9353cbdb9d46 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 200 len: 352 microversion: 2.1 time: 0.178221 Jul 29 06:26:29.723676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 7/11] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:29 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 352 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:26:29.830207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4559be9d-b7a2-4757-ab5f-873c22e18d91 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 200 len: 287 microversion: 2.1 time: 0.223691 Jul 29 06:26:29.831097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 5/12] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:29 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 287 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:30.741249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c5fc0dba-2b36-4f48-944f-4d7f56923219 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8edf70>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:30.843194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-847e01c8-325c-48b2-985f-65286868f285 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8efc10>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:30.873418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c5fc0dba-2b36-4f48-944f-4d7f56923219 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 200 len: 352 microversion: 2.1 time: 0.140702 Jul 29 06:26:30.873978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 8/13] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:30 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 352 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:30.916199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-847e01c8-325c-48b2-985f-65286868f285 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 200 len: 287 microversion: 2.1 time: 0.077136 Jul 29 06:26:30.916811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 6/14] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:30 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:26:30.990928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1378332564", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "networks": [{"uuid": "66b05c42-f6f7-4765-aee1-398508ccfa33"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:31.147018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] validate_networks() for [('66b05c42-f6f7-4765-aee1-398508ccfa33', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:26:31.887070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6ecb4f93-1560-47b2-9d98-c851ddbf48c3 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b905040>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:31.988368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6ecb4f93-1560-47b2-9d98-c851ddbf48c3 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 200 len: 352 microversion: 2.1 time: 0.104957 Jul 29 06:26:31.989225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 7/15] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:31 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:31.993784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f823c632-ec22-4d07-b930-5f09b6da55f1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8fe040>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:32.044426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f823c632-ec22-4d07-b930-5f09b6da55f1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 200 len: 287 microversion: 2.1 time: 0.054048 Jul 29 06:26:32.045434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:31 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:33.002804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85832119-05e9-46fd-aa6d-8727bbd4ab89 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Calling method '.version_select at 0x7f145b8fe820>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:33.068056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-85832119-05e9-46fd-aa6d-8727bbd4ab89 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] HTTP exception thrown: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85832119-05e9-46fd-aa6d-8727bbd4ab89 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Request method failure captured: Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f HTTP/1.1 Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432OmfwnJuawe4j3jHQO1_NEtQPJvkbiDzgsHmSI663s66yfYNgR2ebCaxLVavlEjz30VI6rH1kRf7MGX-9otXIb8nY-j9boDe4SGSwA3C1EEfGmy3jPZrWO2aebHYUN5cMzcGTAzVMsx7AAZFCNtMcf6_DX85IhIX-bX-MzlaHQ-40 Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 3b9457137fc44f718e0937bf290a6c2c Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesGetTestJSON-1995508479 Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:26:33.075031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/3b9457137fc44f718e0937bf290a6c2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b9457137fc44f718e0937bf290a6c2c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_3b9457137fc44f718e0937bf290a6c2c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/3b9457137fc44f718e0937bf290a6c2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesGetTestJSON-1995508479 Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 3b9457137fc44f718e0937bf290a6c2c Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesGetTestJSON-1995508479 Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesGetTestJSON-1995508479-project Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: bb8fc2726c424abca15ad3197f1e7f38 Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesGetTestJSON-1995508479-project Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'd298ee4a-aaa9-4762-98d5-95848929371f'} Jul 29 06:26:33.076312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. (HTTP 404) (Request-ID: req-12e1b630-9c79-46a4-9dd6-30357ff31b12) Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:33.077074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:33.078142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 06:26:33.079718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. Jul 29 06:26:33.081036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:33.084423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85832119-05e9-46fd-aa6d-8727bbd4ab89 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] Returning 404 to user: Volume d298ee4a-aaa9-4762-98d5-95848929371f could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:26:33.084423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-85832119-05e9-46fd-aa6d-8727bbd4ab89 tempest-VolumesGetTestJSON-1995508479 tempest-VolumesGetTestJSON-1995508479-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f" status: 404 len: 109 microversion: 2.1 time: 0.085866 Jul 29 06:26:33.085212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 9/17] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:32 2022] GET /compute/v2.1/os-volumes/d298ee4a-aaa9-4762-98d5-95848929371f => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:26:33.107590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6a43c9cf-9903-4f0e-9a1b-007fbb9f3563 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905310>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:33.311303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6a43c9cf-9903-4f0e-9a1b-007fbb9f3563 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 200 len: 288 microversion: 2.1 time: 0.223408 Jul 29 06:26:33.311881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 10/18] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:33 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 288 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:33.324214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-289a97be-e1be-4551-a7a1-19ab717455ca tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905670>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:33.471509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-289a97be-e1be-4551-a7a1-19ab717455ca tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 202 len: 0 microversion: 2.1 time: 0.151585 Jul 29 06:26:33.472858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 11/19] 10.222.0.33 () {58 vars in 1254 bytes} [Fri Jul 29 06:26:33 2022] DELETE /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 06:26:33.481538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7eaa0f59-7f5b-405a-b27b-38a81fc76b9c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8713a0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:33.581870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7eaa0f59-7f5b-405a-b27b-38a81fc76b9c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 200 len: 287 microversion: 2.1 time: 0.104549 Jul 29 06:26:33.582596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 12/20] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:33 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:26:33.875946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:26:33.879965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:26:33.879965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:26:33.879965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:26:33.879965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:26:33.934426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:33.937918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:33.940758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:33.941738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:34.075367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Getting quotas for project 5ed8bbfcf5ec4f74baf644f4a9d5f200. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:26:34.103813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Getting quotas for user d1e3dde3b1fd48f89f553ccf1dc76a13 and project 5ed8bbfcf5ec4f74baf644f4a9d5f200. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:26:34.161680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:26:34.164447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:26:34.404812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca845e29-3af9-43e9-8d04-199e9ab56cc8 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.518314 Jul 29 06:26:34.406134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 9/21] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:26:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 06:26:34.418027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b8431cc1-5cf3-431c-a9fa-039049396020 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:34.419346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b8431cc1-5cf3-431c-a9fa-039049396020 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:34.877482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-283633229", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:35.007895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] validate_networks() for [('8016328e-1678-4850-8f2e-16c509f3c821', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:26:35.183136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8431cc1-5cf3-431c-a9fa-039049396020 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:35.217655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b8431cc1-5cf3-431c-a9fa-039049396020 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1215 microversion: 2.1 time: 0.802380 Jul 29 06:26:35.220776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 13/22] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:34 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1215 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:35.226900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3711ae73-0df5-41dd-98ae-885d214658ba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905af0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:35.289405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-3711ae73-0df5-41dd-98ae-885d214658ba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] HTTP exception thrown: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3711ae73-0df5-41dd-98ae-885d214658ba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Request method failure captured: Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd HTTP/1.1 Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432PIVEUQJ_6Ziu-DgzA4pnvFwkUy4eNIOK6RwEnp0X0MgQYA1GC4kTlo_T_-Vk66104-eJXe0dSK2L30Tyv-HPsMLqPaXd40X7eI1EufaJ4WCo0s0XhjVNgo0quo8jUhTyXHOVX2C8O6HtVVIQQCcaNVlYuOCi4MvpPtwSJ01ozRSo Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:26:35.304616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd0ca31db2cb4b4da308a70b6954629c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 6f4c287c2adf4196b3d0211cef42afe5 Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '9392db42-c0da-4f8c-bc09-516bfa9575dd'} Jul 29 06:26:35.305768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. (HTTP 404) (Request-ID: req-262c3064-4e37-451d-8f3f-500442b6f0a1) Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.306459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:35.307416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 06:26:35.308416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3711ae73-0df5-41dd-98ae-885d214658ba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Returning 404 to user: Snapshot 9392db42-c0da-4f8c-bc09-516bfa9575dd could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:26:35.309638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3711ae73-0df5-41dd-98ae-885d214658ba tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd" status: 404 len: 111 microversion: 2.1 time: 0.085840 Jul 29 06:26:35.313519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 14/23] 10.222.0.33 () {58 vars in 1251 bytes} [Fri Jul 29 06:26:35 2022] GET /compute/v2.1/os-snapshots/9392db42-c0da-4f8c-bc09-516bfa9575dd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:26:35.326837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22886665-173c-4af6-a194-61776e978ce7 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b843af0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:35.502413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22886665-173c-4af6-a194-61776e978ce7 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 202 len: 0 microversion: 2.1 time: 0.186766 Jul 29 06:26:35.506618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 15/24] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:26:35 2022] DELETE /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:26:35.511519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8844f7b6-0a1a-414f-a7bc-606893391096 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905af0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:35.586018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8844f7b6-0a1a-414f-a7bc-606893391096 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 200 len: 345 microversion: 2.1 time: 0.078279 Jul 29 06:26:35.593208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 16/25] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:35 2022] GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:36.240230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-60be599c-f751-4058-b10e-e8568e95aab1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:36.240895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-60be599c-f751-4058-b10e-e8568e95aab1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:36.433742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-60be599c-f751-4058-b10e-e8568e95aab1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:36.448366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-60be599c-f751-4058-b10e-e8568e95aab1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1215 microversion: 2.1 time: 0.212179 Jul 29 06:26:36.450881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 17/26] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:36 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1215 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:36.601537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-332bb904-7a30-4a84-9ca6-65dc3e4cea24 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b8431f0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:36.724214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-332bb904-7a30-4a84-9ca6-65dc3e4cea24 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 200 len: 345 microversion: 2.1 time: 0.126939 Jul 29 06:26:36.725391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 18/27] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:36 2022] GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:37.086114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:26:37.086650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:26:37.087505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:26:37.087961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:26:37.088608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:26:37.117393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:37.122947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:37.131453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:37.132065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:37.226255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for project 872e2c13f9b346598c261de5609fdf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:26:37.247049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for user b34e3e2e2e6049428295588959ca595c and project 872e2c13f9b346598c261de5609fdf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:26:37.286487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:26:37.294185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:26:37.438340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e93527e8-8cde-490f-86ef-73e26cd36de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.893454 Jul 29 06:26:37.448737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 10/28] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:26:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 06:26:37.453459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ed030c22-f2b1-4d15-9900-2f7c04ad8c51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:37.454858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ed030c22-f2b1-4d15-9900-2f7c04ad8c51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:37.474088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:37.474900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:37.506882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:37.507398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:37.509993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:37.511733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:37.812424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ed030c22-f2b1-4d15-9900-2f7c04ad8c51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:37.835224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ed030c22-f2b1-4d15-9900-2f7c04ad8c51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1221 microversion: 2.1 time: 0.386180 Jul 29 06:26:37.842234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 19/29] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:37 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1221 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:26:37.867200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-18c48f37-29ae-470f-9c82-5b57e2a13e33 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905af0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:37.938745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-18c48f37-29ae-470f-9c82-5b57e2a13e33 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] HTTP exception thrown: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-18c48f37-29ae-470f-9c82-5b57e2a13e33 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Request method failure captured: Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 HTTP/1.1 Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432PIVEUQJ_6Ziu-DgzA4pnvFwkUy4eNIOK6RwEnp0X0MgQYA1GC4kTlo_T_-Vk66104-eJXe0dSK2L30Tyv-HPsMLqPaXd40X7eI1EufaJ4WCo0s0XhjVNgo0quo8jUhTyXHOVX2C8O6HtVVIQQCcaNVlYuOCi4MvpPtwSJ01ozRSo Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:26:37.941121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd0ca31db2cb4b4da308a70b6954629c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 6f4c287c2adf4196b3d0211cef42afe5 Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'f9dff889-7597-4d15-bd61-4bc2e9e7cd90'} Jul 29 06:26:37.942346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. (HTTP 404) (Request-ID: req-d76f5079-b803-426e-84d1-7ddb589c2848) Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:37.943140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:37.944272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 06:26:37.946076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:37.947145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-18c48f37-29ae-470f-9c82-5b57e2a13e33 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Returning 404 to user: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:26:37.948572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-18c48f37-29ae-470f-9c82-5b57e2a13e33 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 404 len: 109 microversion: 2.1 time: 0.105116 Jul 29 06:26:37.949364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 20/30] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:37 2022] GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:26:37.965042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4a036e0b-ca6e-4224-9f42-51a029d31ea1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b843d30>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:38.027642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-4a036e0b-ca6e-4224-9f42-51a029d31ea1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] HTTP exception thrown: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4a036e0b-ca6e-4224-9f42-51a029d31ea1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Request method failure captured: Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 HTTP/1.1 Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432PIVEUQJ_6Ziu-DgzA4pnvFwkUy4eNIOK6RwEnp0X0MgQYA1GC4kTlo_T_-Vk66104-eJXe0dSK2L30Tyv-HPsMLqPaXd40X7eI1EufaJ4WCo0s0XhjVNgo0quo8jUhTyXHOVX2C8O6HtVVIQQCcaNVlYuOCi4MvpPtwSJ01ozRSo Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:26:38.029832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd0ca31db2cb4b4da308a70b6954629c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 6f4c287c2adf4196b3d0211cef42afe5 Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'f9dff889-7597-4d15-bd61-4bc2e9e7cd90'} Jul 29 06:26:38.030902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. (HTTP 404) (Request-ID: req-71b581cf-8f46-4440-918a-53fb2f6c53ec) Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:38.031537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 06:26:38.034519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 06:26:38.035530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4a036e0b-ca6e-4224-9f42-51a029d31ea1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Returning 404 to user: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4a036e0b-ca6e-4224-9f42-51a029d31ea1 tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 404 len: 109 microversion: 2.1 time: 0.071033 Jul 29 06:26:38.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 21/31] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:26:37 2022] DELETE /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:26:38.046472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6660738c-4d2a-4952-b24a-15efddac635c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Calling method '.version_select at 0x7f145b905ca0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:38.071245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:38.144352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a955043d-22df-4f3b-b5c2-0c0e79b0d2ef tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1211 microversion: 2.1 time: 0.676565 Jul 29 06:26:38.148847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 11/32] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:37 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1211 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:26:38.167564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-6660738c-4d2a-4952-b24a-15efddac635c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] HTTP exception thrown: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6660738c-4d2a-4952-b24a-15efddac635c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Request method failure captured: Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 HTTP/1.1 Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432PIVEUQJ_6Ziu-DgzA4pnvFwkUy4eNIOK6RwEnp0X0MgQYA1GC4kTlo_T_-Vk66104-eJXe0dSK2L30Tyv-HPsMLqPaXd40X7eI1EufaJ4WCo0s0XhjVNgo0quo8jUhTyXHOVX2C8O6HtVVIQQCcaNVlYuOCi4MvpPtwSJ01ozRSo Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:26:38.169954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_bd0ca31db2cb4b4da308a70b6954629c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/bd0ca31db2cb4b4da308a70b6954629c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: bd0ca31db2cb4b4da308a70b6954629c Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1717085319 Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 6f4c287c2adf4196b3d0211cef42afe5 Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1717085319-project Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'f9dff889-7597-4d15-bd61-4bc2e9e7cd90'} Jul 29 06:26:38.170983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. (HTTP 404) (Request-ID: req-7a2ba20c-9b0b-485e-bb7d-89196694bafb) Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:38.171591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:26:38.172496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 06:26:38.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6660738c-4d2a-4952-b24a-15efddac635c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] Returning 404 to user: Volume f9dff889-7597-4d15-bd61-4bc2e9e7cd90 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6660738c-4d2a-4952-b24a-15efddac635c tempest-VolumesSnapshotsTestJSON-1717085319 tempest-VolumesSnapshotsTestJSON-1717085319-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90" status: 404 len: 109 microversion: 2.1 time: 0.132068 Jul 29 06:26:38.174284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 22/33] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:26:38 2022] GET /compute/v2.1/os-volumes/f9dff889-7597-4d15-bd61-4bc2e9e7cd90 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:26:38.200283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-421488339", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:38.333020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] validate_networks() for [('8016328e-1678-4850-8f2e-16c509f3c821', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:26:39.180601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:39.181265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:39.194002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:39.194804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:39.195804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:39.196385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:39.467086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:39.490881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9fc0bea4-a075-481f-b8cf-3235686282b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1273 microversion: 2.1 time: 0.318472 Jul 29 06:26:39.492212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 23/34] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:39 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1273 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:40.374497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-84bd64c0-152a-4e5b-bf7f-88a4f3b958e9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'create', calling method: .version_select at 0x7f145b905af0>, body: {"keypair": {"name": "tempest-keypair-1632682904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6QhPEGiByOSAgcy01FHwj/3ULUB3N1qlxwcblP1bidlUV9CdDAQCJJEHH+CQqlRwsOPNpr3ciot+qpPtchDGKg8JDn7aZs8CUqz4skBFnikqYFGwZs5efLOQF/zSsu+Q=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:40.487225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-84bd64c0-152a-4e5b-bf7f-88a4f3b958e9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for project a3b773b1bba540f79c21b042d5cf91de. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:26:40.517566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-84bd64c0-152a-4e5b-bf7f-88a4f3b958e9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for user e1b9767f26254a6cba945f4cae562b70 and project a3b773b1bba540f79c21b042d5cf91de. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:26:40.648944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-84bd64c0-152a-4e5b-bf7f-88a4f3b958e9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.153356 Jul 29 06:26:40.655497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 24/35] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 06:26:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:40.675273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:40.693887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:40.715032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:40.736755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:40.737667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:40.738173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:41.304879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:41.314843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3dfb6675-ce5b-415d-888e-b3e0a30da807 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1273 microversion: 2.1 time: 0.650008 Jul 29 06:26:41.317320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 25/36] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:40 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1273 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:42.347329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:42.348884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:42.358042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:42.377435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:42.385274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:42.387550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:43.634278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:43.646088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-52a5060e-f467-461f-a889-983464b6d1d1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 1.303090 Jul 29 06:26:43.646803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 26/37] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:42 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:44.077539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:26:44.080195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:26:44.080952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:26:44.081584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:26:44.082710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:26:44.124956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:44.127563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:44.129198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:44.131954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:44.185847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for project 872e2c13f9b346598c261de5609fdf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:26:44.205765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for user b34e3e2e2e6049428295588959ca595c and project 872e2c13f9b346598c261de5609fdf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:26:44.241049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:26:44.247527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:26:44.363304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9173db5e-863b-4fcc-97ef-37ca9e0f506f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.164878 Jul 29 06:26:44.366745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 12/38] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:26:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 6171 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:26:44.375745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e3691e4c-4893-4469-b865-6e7e4ac4be93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:44.378414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e3691e4c-4893-4469-b865-6e7e4ac4be93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:44.670668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:44.671559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:44.683931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:44.684407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:44.685258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:44.685701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:44.711531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e3691e4c-4893-4469-b865-6e7e4ac4be93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:44.725929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e3691e4c-4893-4469-b865-6e7e4ac4be93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1221 microversion: 2.1 time: 0.354391 Jul 29 06:26:44.742060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 27/39] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:44 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1221 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:45.751973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:45.753422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:45.780835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:45.790904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0db734d9-3500-4702-a79a-79cefb26cd53 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 1.124890 Jul 29 06:26:45.792366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:45.803388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:45.811506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 13/40] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:44 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:45.813185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:45.814746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:46.448379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:46.461592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cae933cf-c93f-42b6-ac6b-f6cfb94ab807 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1225 microversion: 2.1 time: 0.717989 Jul 29 06:26:46.473398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 28/41] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:45 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1225 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:46.833382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:46.835014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:46.850803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:46.851737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:46.852862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:46.855392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:47.493669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:47.495149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:47.520800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:47.523122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:47.524206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:47.527449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:48.002142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:48.016209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-23f980a8-583a-4ee2-8517-b093c580dd1a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 1.187649 Jul 29 06:26:48.029357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 14/42] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:46 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:26:49.042933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:49.043612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:49.061627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:49.064895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:49.069098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:49.072478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:49.148943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:49.166431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ea225f9d-ae52-4225-9460-7574d13c68b4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1291 microversion: 2.1 time: 1.677431 Jul 29 06:26:49.184991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 29/43] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:47 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1291 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:49.878971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3771705e-6dec-4239-bf3d-0a119d2f582b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'create', calling method: .version_select at 0x7f145b744e50>, body: {"keypair": {"name": "tempest-keypair-562867276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG0D8PrFtVOPaf8oF3w8FWqI+XsVHK8qDp1bfv5urHJUV4OaiUuNbGkRYyz/aBFQFnFwj6lnHzR7dJ6wObov2zHmPR2TUvFQqk1ms8ofn9NjPYVteu1QqBceTYQCEF2AMw=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:49.941762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-3771705e-6dec-4239-bf3d-0a119d2f582b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for project f8d1f62a52884ebb91749ef49de11bec. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:26:49.953541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-3771705e-6dec-4239-bf3d-0a119d2f582b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for user 217b321936224e2ba928b983c4e40017 and project f8d1f62a52884ebb91749ef49de11bec. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:26:50.005927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3771705e-6dec-4239-bf3d-0a119d2f582b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.818297 Jul 29 06:26:50.007832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 30/44] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Jul 29 06:26:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 822 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 06:26:50.191808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:50.192668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:50.206970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:50.207190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:50.213026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:50.213508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:51.093347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:51.107568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8576f51e-6fbc-4327-bd34-1f0b94e200e0 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 2.068978 Jul 29 06:26:51.130496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 15/45] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:49 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:51.144631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:51.167171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-349bc2c2-c839-4df8-8026-94401c9b5267 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1279 microversion: 2.1 time: 0.979810 Jul 29 06:26:51.171540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 31/46] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:50 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1279 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:52.129731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:52.131143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:52.146360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.147223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.150355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.151834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.193908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:52.194641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:52.204333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.209235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.210159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.210666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.460854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:52.478631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b7612ebd-acfc-4d3e-a3bf-954314132c88 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1279 microversion: 2.1 time: 0.284146 Jul 29 06:26:52.481058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 32/47] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:52 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1279 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:52.628888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-997e79a7-6daa-4bff-90db-77107edc5a8a req-c5d72e94-23c1-4f63-ad1f-ea8faace32eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "accf1ede-e9d8-416c-b579-97df69af233d", "tag": "47884efd-6341-439f-8e11-76bf83432aa4"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:52.667164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-997e79a7-6daa-4bff-90db-77107edc5a8a req-c5d72e94-23c1-4f63-ad1f-ea8faace32eb service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.670397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-997e79a7-6daa-4bff-90db-77107edc5a8a req-c5d72e94-23c1-4f63-ad1f-ea8faace32eb service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.724048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-997e79a7-6daa-4bff-90db-77107edc5a8a req-c5d72e94-23c1-4f63-ad1f-ea8faace32eb service nova] Creating event network-changed:47884efd-6341-439f-8e11-76bf83432aa4 for instance accf1ede-e9d8-416c-b579-97df69af233d on hv-cinder-83482 Jul 29 06:26:52.725002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-997e79a7-6daa-4bff-90db-77107edc5a8a req-c5d72e94-23c1-4f63-ad1f-ea8faace32eb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117957) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 06:26:52.735371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.736339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.737435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:52.738032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:52.757723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.compute.rpcapi [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 06:26:52.758873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] Releasing lock "compute-rpcapi-router" {{(pid=117957) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 06:26:52.797449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c446f3f2-4c50-472a-8596-7784aaa3cac2 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.314431 Jul 29 06:26:52.798590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 33/48] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:26:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:53.405051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:53.412923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59b69a86-1021-4975-b377-ea75eec6e782 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 1.287425 Jul 29 06:26:53.413512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 16/49] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:52 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:53.432057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1356968695", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e48f73d3-d5d1-41f9-95a6-4ab182e46c68"}], "security_groups": [{"name": "tempest-securitygroup--1067454345"}], "key_name": "tempest-keypair-1632682904", "user_data": "}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:53.501375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:53.502019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:53.517072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=9 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:53.518845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:53.519208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:53.520002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:53.520445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:53.815673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:53.830128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1f6150a6-19aa-42de-88e9-ec56dd90d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1279 microversion: 2.1 time: 0.332987 Jul 29 06:26:53.834161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 17/50] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:53 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1279 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:54.401660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] validate_networks() for [('e48f73d3-d5d1-41f9-95a6-4ab182e46c68', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:26:54.434309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:54.435931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:54.446210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:54.448324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=18 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:26:54.456310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:54.458954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:54.460099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:54.462504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:55.198480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:55.210424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-16ec6d31-0dab-43cf-a7f2-2facc2b4406f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.777483 Jul 29 06:26:55.213109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 18/51] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:54 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:55.228737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:55.229340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:55.259770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:55.260251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:55.261102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:55.264790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:55.629872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:55.649618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3bb95b88-34af-4de5-9712-1c4814a1949c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1279 microversion: 2.1 time: 0.432297 Jul 29 06:26:55.653411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 19/52] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:55 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1279 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:56.241327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:56.241865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:56.265017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:56.267089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:56.286815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:56.287355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:56.977578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:56.991126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dab2f517-4211-43c7-8ee4-0427a112fb21 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.754998 Jul 29 06:26:57.004774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 20/53] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:56 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:57.014666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:57.017186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:57.043717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:57.044282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:57.048576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:57.048935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:57.333089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:57.357879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-79f7629f-100d-4d42-9a83-ed96f4277b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.357531 Jul 29 06:26:57.362964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 21/54] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:56 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:58.013928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:58.014563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:58.023400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.025634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.027380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.028765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.248287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:58.261830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-02a35311-f11a-4cf2-94f2-0b742c6cc22a tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.251779 Jul 29 06:26:58.264664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 22/55] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:58 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:58.473114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-0bcc0ef3-1962-49c4-9ad9-62acaa788d3b req-e834b5f5-9e1c-4872-a4e7-322de35c722a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dc91c9-6f94-4b19-a397-19669b267c43", "tag": "46170f3e-ab09-4001-b12d-354d2c3ac6c5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:26:58.487297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0bcc0ef3-1962-49c4-9ad9-62acaa788d3b req-e834b5f5-9e1c-4872-a4e7-322de35c722a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.488332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0bcc0ef3-1962-49c4-9ad9-62acaa788d3b req-e834b5f5-9e1c-4872-a4e7-322de35c722a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.515103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-0bcc0ef3-1962-49c4-9ad9-62acaa788d3b req-e834b5f5-9e1c-4872-a4e7-322de35c722a service nova] Creating event network-changed:46170f3e-ab09-4001-b12d-354d2c3ac6c5 for instance f5dc91c9-6f94-4b19-a397-19669b267c43 on hv-cinder-83482 Jul 29 06:26:58.516253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0bcc0ef3-1962-49c4-9ad9-62acaa788d3b req-e834b5f5-9e1c-4872-a4e7-322de35c722a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117958) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 06:26:58.517663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.518340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.519502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.520184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.531518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.compute.rpcapi [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 06:26:58.533074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] Releasing lock "compute-rpcapi-router" {{(pid=117958) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 06:26:58.552418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-70bc4cbe-3d47-431c-b89b-a5e93fb8f78d None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.262894 Jul 29 06:26:58.553879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 23/56] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:26:58.560555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:58.562752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:58.575279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.575934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.577244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:58.578450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:58.799296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:58.811428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eb6d23b1-a927-4d9a-8dac-26c6e58edb1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.255859 Jul 29 06:26:58.812030 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 24/57] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:58 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:59.139955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:26:59.140473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:26:59.140946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:26:59.141472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:26:59.141905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:26:59.159243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:59.159705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:59.175083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:59.177461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:59.264969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for project a3b773b1bba540f79c21b042d5cf91de. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:26:59.281808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for user e1b9767f26254a6cba945f4cae562b70 and project a3b773b1bba540f79c21b042d5cf91de. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:26:59.287796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:59.289276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:59.317442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:59.327610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:59.329819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:26:59.330244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:59.330862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:59.345744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:26:59.546191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-86b12ed6-14e8-4342-a0ae-547aac472098 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 6.130157 Jul 29 06:26:59.548380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 34/58] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:26:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 6133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:26:59.568691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9e69ac3a-27c7-4d0c-9792-5de655ed392d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:59.572283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9e69ac3a-27c7-4d0c-9792-5de655ed392d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:59.717492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:59.731487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef53d9aa-01aa-4b69-bcc3-c39dc8f26c98 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.449038 Jul 29 06:26:59.737499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 25/59] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:59 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:26:59.845478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:26:59.846414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:26:59.860234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:59.860823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:59.861625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:26:59.862062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:26:59.939892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9e69ac3a-27c7-4d0c-9792-5de655ed392d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:26:59.954617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9e69ac3a-27c7-4d0c-9792-5de655ed392d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1238 microversion: 2.1 time: 0.394265 Jul 29 06:26:59.955726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 35/60] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:59 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1238 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:00.334763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:00.348913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-df43d500-4e83-424c-b9a7-45760f8cbbe4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.509419 Jul 29 06:27:00.352604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 26/61] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:26:59 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:00.745744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-8012dbcb-e4c5-460b-a240-36051780663d req-52d38f1d-7991-4492-959f-967ec3f88a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65", "tag": "c4cfd182-fc76-4e2f-8b38-5663e698a6ba"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:00.756983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:00.757612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:00.770492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:00.770635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-8012dbcb-e4c5-460b-a240-36051780663d req-52d38f1d-7991-4492-959f-967ec3f88a95 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:00.770952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:00.771608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-8012dbcb-e4c5-460b-a240-36051780663d req-52d38f1d-7991-4492-959f-967ec3f88a95 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:00.772148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:00.772762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:00.802101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-8012dbcb-e4c5-460b-a240-36051780663d req-52d38f1d-7991-4492-959f-967ec3f88a95 service nova] Creating event network-changed:c4cfd182-fc76-4e2f-8b38-5663e698a6ba for instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 on hv-cinder-83482 Jul 29 06:27:00.818785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-8012dbcb-e4c5-460b-a240-36051780663d req-52d38f1d-7991-4492-959f-967ec3f88a95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081595 Jul 29 06:27:00.822895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 36/62] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:00.978759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:00.979530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:00.989479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:00.989941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:00.990731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:00.997939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:01.017978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:01.021949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:01.027802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b0fbec24-1eab-41c2-94ce-a5dadb42d91b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.274158 Jul 29 06:27:01.029138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 27/63] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:00 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:01.128903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:01.136463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2f318b48-d257-4881-8839-c9400f5a2d39 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1242 microversion: 2.1 time: 0.162869 Jul 29 06:27:01.137569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 37/64] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:00 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:01.378659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:01.381512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:01.393716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:01.394464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:01.395508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:01.396089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:01.506124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-415673053", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40674957-e65b-42f3-b74b-29bebe673dc8"}], "security_groups": [{"name": "tempest-securitygroup--1096159983"}], "key_name": "tempest-keypair-562867276", "user_data": "}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:01.620243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] validate_networks() for [('40674957-e65b-42f3-b74b-29bebe673dc8', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:27:01.701814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:01.713514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e7ea74e0-f111-4291-8580-4b662f883eec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.341384 Jul 29 06:27:01.715408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 28/65] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:01 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:02.051797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:02.052487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:02.059851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.061593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.063290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.064295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.211600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:27:02.212331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:27:02.215693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:27:02.217548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:27:02.220648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:27:02.244474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.245417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.247550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.248297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.268664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:02.272455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for project f8d1f62a52884ebb91749ef49de11bec. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:27:02.277053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for user 217b321936224e2ba928b983c4e40017 and project f8d1f62a52884ebb91749ef49de11bec. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:27:02.282858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a8d89b39-74cc-45d3-b4b9-c20ef07645fd tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.235003 Jul 29 06:27:02.283965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 29/66] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:02 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:02.292184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:27:02.297760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:27:02.300465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:02.301229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:02.310385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.311012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.313579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.313997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.349673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:02.376468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-537d9977-acd9-4919-b6b4-07fa301bf7c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.874826 Jul 29 06:27:02.377533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 38/67] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Jul 29 06:27:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 29 06:27:02.395582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2b1fd267-8da9-40d1-be77-da274ba4b47e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:02.396380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2b1fd267-8da9-40d1-be77-da274ba4b47e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:02.466784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:02.485742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-92f3415c-7a5f-41e9-b885-99fd2260659d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1242 microversion: 2.1 time: 0.199898 Jul 29 06:27:02.486961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 30/68] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:02 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1242 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:02.629568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2b1fd267-8da9-40d1-be77-da274ba4b47e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:02.643140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2b1fd267-8da9-40d1-be77-da274ba4b47e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:02.644703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2b1fd267-8da9-40d1-be77-da274ba4b47e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:02.658170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2b1fd267-8da9-40d1-be77-da274ba4b47e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1280 microversion: 2.20 time: 0.266450 Jul 29 06:27:02.658816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 39/69] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1280 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:02.741332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:02.745149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:02.772348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.777545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:02.782820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:02.783839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.306977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:03.310239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:03.311525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:03.323177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4bd14e8b-e96f-4b2c-85e5-8c5c26db3706 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.587452 Jul 29 06:27:03.325221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 31/70] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:02 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:03.326145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:03.327179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.333804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:03.334383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.516626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:03.518412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:03.530396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:03.533007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.541242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:03.544405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.824900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:03.836051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cab25b3b-cbdf-4be7-9743-3773841999e3 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.530677 Jul 29 06:27:03.841323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 40/71] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:03 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:03.861535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:03.862423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:03.877520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:03.878669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.887370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:03.888159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:03.888896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:03.908329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-085f7af8-37d9-40c1-b842-c52f3968e228 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1308 microversion: 2.1 time: 0.398799 Jul 29 06:27:03.912250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 32/72] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:03 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1308 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:04.050784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:04.059520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:04.061310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:04.062671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3a67892e-6fbf-41ad-8ca9-622055125f76 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1332 microversion: 2.20 time: 0.220159 Jul 29 06:27:04.063874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 41/73] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1332 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:04.347069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:04.348466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:04.354977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:04.355519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:04.356566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:04.357313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:04.583620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:04.591617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-92e19c69-a68c-44da-8d73-d5d4d658b61b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.248794 Jul 29 06:27:04.592620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 33/74] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:04 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:04.858419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:04.859620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:04.865723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:04.866174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:04.866969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:04.867406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:04.871446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=71 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:04.933511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:04.934111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:04.948182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:04.949473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:04.950440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:04.951038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:05.029737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:05.040904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0baa8025-f196-43dd-b75b-bd3579738d59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1296 microversion: 2.1 time: 0.110827 Jul 29 06:27:05.042600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 34/75] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:04 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1296 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:05.061400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:05.069566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3d2feea7-03ff-4b48-8aeb-82806a06fa3f tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.215049 Jul 29 06:27:05.070230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 42/76] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:04 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:05.090146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:05.090878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:05.097587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:05.098043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:05.098814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:05.099248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:05.194880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:05.203539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:05.205060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:05.206590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3d97c7f9-ebee-4632-8a1f-cfc984d3d4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1332 microversion: 2.20 time: 0.120743 Jul 29 06:27:05.207280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 35/77] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1332 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:05.613166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:05.613783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:05.626475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:05.627006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:05.627935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:05.628380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:05.807417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:05.816033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8929fe89-398e-4871-9c7b-7c19c896c719 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.207326 Jul 29 06:27:05.816873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 43/78] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:05 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:05.929878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-1a2e664b-12a9-4216-87cf-bd67fc047bb6 req-15fa2379-e982-4b97-b356-253c53bc9a66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf1ede-e9d8-416c-b579-97df69af233d", "name": "network-vif-plugged", "status": "completed", "tag": "47884efd-6341-439f-8e11-76bf83432aa4"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:05.945140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1a2e664b-12a9-4216-87cf-bd67fc047bb6 req-15fa2379-e982-4b97-b356-253c53bc9a66 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:05.945586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1a2e664b-12a9-4216-87cf-bd67fc047bb6 req-15fa2379-e982-4b97-b356-253c53bc9a66 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:05.958986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-1a2e664b-12a9-4216-87cf-bd67fc047bb6 req-15fa2379-e982-4b97-b356-253c53bc9a66 service nova] Creating event network-vif-plugged:47884efd-6341-439f-8e11-76bf83432aa4 for instance accf1ede-e9d8-416c-b579-97df69af233d on hv-cinder-83482 Jul 29 06:27:05.964472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-1a2e664b-12a9-4216-87cf-bd67fc047bb6 req-15fa2379-e982-4b97-b356-253c53bc9a66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114498 Jul 29 06:27:05.965387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 36/79] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:06.062933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:06.064265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:06.070489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.070942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.071957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.072578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.092309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:06.093902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:06.101914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.102582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.103555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.104187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.141074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:06.150342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e099c18b-bdf8-469d-bb39-8d3875d40264 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1296 microversion: 2.1 time: 0.091200 Jul 29 06:27:06.151585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 44/80] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:06 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:06.231368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:06.232076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:06.240445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.241225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.242741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.243377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.267222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:06.276264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-801a612d-6fbb-40c8-9eaa-8379af8eb80c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.188190 Jul 29 06:27:06.277106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 37/81] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:06 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:06.317239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:06.327275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:06.330337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:06.332512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8ffc9e47-6c0b-4bb9-affe-aee261d33e0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1332 microversion: 2.20 time: 0.104755 Jul 29 06:27:06.333924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 45/82] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:06.837346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:06.837961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:06.849481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.849939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.850731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:06.851182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:06.992267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:07.004914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f986edf7-0314-44f6-a08f-83d891f69c03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.171219 Jul 29 06:27:07.005493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 38/83] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:06 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:07.171538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:07.173300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:07.179873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:07.180400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:07.181273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:07.181798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:07.271769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:07.277153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b197ae0b-d486-4f14-8059-46b072d759c6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1296 microversion: 2.1 time: 0.109715 Jul 29 06:27:07.278231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 46/84] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:07 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:07.299863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:07.300485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:07.307201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:07.307659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:07.308437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:07.308957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:07.356619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:07.357602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:07.371257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:07.376030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:07.376030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:07.376030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:07.507694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:07.529588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:07.541472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:07.542812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fead9d87-1660-4f55-b3b2-95370de063c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1332 microversion: 2.20 time: 0.190232 Jul 29 06:27:07.547630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 47/85] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1332 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:07.620594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:07.632959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2639d89d-e531-4f31-b8aa-64cf87be721c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.338006 Jul 29 06:27:07.634286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 39/86] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:07 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:08.026522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:08.027404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:08.035365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.036064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.037030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.037693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.300465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:08.301112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:08.312259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.313248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.314321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.315115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.502306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:08.511534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fffd4526-bbc3-4ba3-ad37-33b7e69853ef tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1296 microversion: 2.1 time: 0.215982 Jul 29 06:27:08.512835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 40/87] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:08 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1296 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:08.591436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:08.592480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:08.596790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:08.602648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.603356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.604179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.604524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.612828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:08.621109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0559635f-f6bd-448a-ba7c-af8d79d90db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.598395 Jul 29 06:27:08.621688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 48/88] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:08 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:08.656411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:08.657270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:08.663498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.664138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.664932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:08.665365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:08.756271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:08.764661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:08.766720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:08.767835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0772df91-ffb4-430a-b378-c3454edca610 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1338 microversion: 2.20 time: 0.204101 Jul 29 06:27:08.768382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 41/89] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1338 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:08.976495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:08.984440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5fc4cc2f-a4b8-42d7-ba0c-f3a3afae5e13 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.331798 Jul 29 06:27:08.985785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 49/90] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:08 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:09.534456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:09.535179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:09.541994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:09.542875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:09.543875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:09.544686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:09.646902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:09.647664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:09.660722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:09.661378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:09.662676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:09.663263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:09.852885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:09.864587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-14ef8886-e16c-4251-9a28-8e652230fa59 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.334201 Jul 29 06:27:09.869705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 42/91] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:09 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:09.875784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:09.876404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:09.884469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:09.885914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:09.888606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:09.889287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:09.899507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:09.910559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8f60048-5a33-460d-9b2a-b4562ce35b26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.269403 Jul 29 06:27:09.923022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 50/92] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:09 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:09.994341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:10.005486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:10.007408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:10.008919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b90392ef-2e05-4f63-8e3a-9e6c837e93e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1338 microversion: 2.20 time: 0.138068 Jul 29 06:27:10.010129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:10.010540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:10.010915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 43/93] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1338 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:10.026544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.027299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:10.028588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.029017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:10.242938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:10.255743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f5dee0f2-8289-4dec-98a0-4b6e1818db5d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.248558 Jul 29 06:27:10.276766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 51/94] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:10 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:10.459598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-205425d8-c264-45e9-8294-fd77fd4a5098 req-04603649-c0fb-433a-a28c-bf8c8d35383a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f47fa5-72de-4c83-a201-89fb8435978e", "tag": "f24af601-0f43-41c4-bb28-56b5a48554aa"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:10.512127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-205425d8-c264-45e9-8294-fd77fd4a5098 req-04603649-c0fb-433a-a28c-bf8c8d35383a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.512868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-205425d8-c264-45e9-8294-fd77fd4a5098 req-04603649-c0fb-433a-a28c-bf8c8d35383a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:10.529538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-205425d8-c264-45e9-8294-fd77fd4a5098 req-04603649-c0fb-433a-a28c-bf8c8d35383a service nova] Creating event network-changed:f24af601-0f43-41c4-bb28-56b5a48554aa for instance c0f47fa5-72de-4c83-a201-89fb8435978e on hv-cinder-83482 Jul 29 06:27:10.536745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-205425d8-c264-45e9-8294-fd77fd4a5098 req-04603649-c0fb-433a-a28c-bf8c8d35383a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081836 Jul 29 06:27:10.538283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 44/95] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:10.892965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:10.893627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:10.899858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.900461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:10.901287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.901728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:10.935778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:10.936479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:10.943631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.944268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:10.945342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:10.945720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:11.044099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:11.052186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-743e1255-b124-47fa-abc6-58f3e13af595 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.163152 Jul 29 06:27:11.052991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 52/96] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:10 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:11.057837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:11.058659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:11.065088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:11.065763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:11.066723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:11.067395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:11.096037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:11.106502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:11.109961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b503a5d-cc14-4195-9749-2fd39f12ba69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.178832 Jul 29 06:27:11.110697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 45/97] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:10 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:11.198202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:11.206723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:11.208481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:11.209659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3e8bd228-f6c7-48ec-adda-ffb95be490a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.155460 Jul 29 06:27:11.210221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 53/98] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:11.279939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:11.281491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:11.288804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:11.289219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:11.289996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:11.290532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:11.675986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:11.684514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-797e1a52-7b48-485e-a6bd-481804adbfde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.408737 Jul 29 06:27:11.685113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 46/99] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:11 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:12.073739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:12.074357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:12.081543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.082074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.083211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.083724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.130963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:12.131591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:12.137962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.138623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.139424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.140739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.260623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:12.276580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:12.287577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b41e4ed3-5e61-44c5-a87d-3ce05b9b9118 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.217624 Jul 29 06:27:12.288652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 54/100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:12 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:12.294679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:12.295500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:12.303450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.303900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.304701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.305329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.315751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:12.327186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4b0c4021-7ac3-4e68-85f7-1aec982d54ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.200082 Jul 29 06:27:12.328707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 47/101] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:12 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:12.472317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:12.481702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:12.484108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:12.485432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aaf7dbc2-2342-4aa2-a6a9-672cc2e479a2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.195635 Jul 29 06:27:12.486007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 55/102] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:12.705790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:12.706380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:12.714833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.715555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:12.716399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:12.717039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.113383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:13.128665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-15deb956-47b1-457f-994d-40cd107139fa tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.426799 Jul 29 06:27:13.129751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 48/103] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:12 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:13.311454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:13.313621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:13.317742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=32 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:13.331121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:13.331585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.332376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:13.333172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.354952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:13.355704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:13.364470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:13.365113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.366589 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:13.367135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.631071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:13.642240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2025264b-8801-4b69-b3ea-1d31fcde9d8f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.332465 Jul 29 06:27:13.643678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 56/104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:13 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:13.659785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:13.662068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:13.680929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:13.681711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.686837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:13.687436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:13.888432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:13.898706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:13.900462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:13.902371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f816a568-3c47-4856-a1e5-0ff5618f3e39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.255218 Jul 29 06:27:13.903088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 57/105] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:13.922390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:13.932159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4f608bb2-9526-4f31-9d76-66436ef4aefd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.581755 Jul 29 06:27:13.933526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 49/106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:13 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:14.152061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:14.152730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:14.161827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.162507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.163951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.164808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.208273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-e1200552-cdc6-4f0e-8621-ccf2ac7a5100 req-6f334adf-cea7-4b5e-8ad5-b76d02427b10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:14.248058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e1200552-cdc6-4f0e-8621-ccf2ac7a5100 req-6f334adf-cea7-4b5e-8ad5-b76d02427b10 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.249859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e1200552-cdc6-4f0e-8621-ccf2ac7a5100 req-6f334adf-cea7-4b5e-8ad5-b76d02427b10 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.330404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-e1200552-cdc6-4f0e-8621-ccf2ac7a5100 req-6f334adf-cea7-4b5e-8ad5-b76d02427b10 service nova] Creating event network-changed:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:27:14.340031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-e1200552-cdc6-4f0e-8621-ccf2ac7a5100 req-6f334adf-cea7-4b5e-8ad5-b76d02427b10 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137436 Jul 29 06:27:14.345989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 50/107] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:27:14.546874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:14.549326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:14.565371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c3bef1f1-3430-407b-ab6f-c0ce32c14a1b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1315 microversion: 2.1 time: 0.417666 Jul 29 06:27:14.572959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 58/108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:14 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1315 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:14.642542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-4712e7b4-29e5-478b-8153-9e10e63a3ca9 req-df2873ca-17d6-4246-9fc4-0569df6fe117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dc91c9-6f94-4b19-a397-19669b267c43", "name": "network-vif-plugged", "status": "completed", "tag": "46170f3e-ab09-4001-b12d-354d2c3ac6c5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:14.675136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:14.676160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:14.687563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4712e7b4-29e5-478b-8153-9e10e63a3ca9 req-df2873ca-17d6-4246-9fc4-0569df6fe117 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.688853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4712e7b4-29e5-478b-8153-9e10e63a3ca9 req-df2873ca-17d6-4246-9fc4-0569df6fe117 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.694096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.694865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.698706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.701124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.731594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-4712e7b4-29e5-478b-8153-9e10e63a3ca9 req-df2873ca-17d6-4246-9fc4-0569df6fe117 service nova] Creating event network-vif-plugged:46170f3e-ab09-4001-b12d-354d2c3ac6c5 for instance f5dc91c9-6f94-4b19-a397-19669b267c43 on hv-cinder-83482 Jul 29 06:27:14.745068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-4712e7b4-29e5-478b-8153-9e10e63a3ca9 req-df2873ca-17d6-4246-9fc4-0569df6fe117 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113010 Jul 29 06:27:14.746468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 51/109] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:14.928216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:14.929847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:14.930642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:14.939271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.939813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.940693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.941332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.943837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9d58f364-478d-4553-9c8c-9df4814e871d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.278606 Jul 29 06:27:14.945224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 59/110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:14 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:14.955811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:14.956957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:14.970215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.971281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:14.973041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:14.973815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:15.147156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:15.156317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f6bcfce4-c23b-43bc-b468-99b8b776ad35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.205641 Jul 29 06:27:15.163226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 60/111] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:14 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:15.198302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:15.206741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:15.208508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:15.209648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e04d6f23-38d7-4a28-aadd-b03d54e7930e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.286180 Jul 29 06:27:15.210183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 52/112] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:15.587246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:15.587987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:15.596262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:15.596753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:15.597522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:15.597965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:15.767005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:15.792756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dffbd3a1-aa9f-4110-8f1e-b1e735e1f53d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1503 microversion: 2.1 time: 0.209271 Jul 29 06:27:15.793442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 61/113] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:15 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1503 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:15.966341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:15.967177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:15.977440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:15.978070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:15.979159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:15.980082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:16.170308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:16.177454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:16.178811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:16.181484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-946c33b6-77e8-4253-81ba-7be42bbb3d79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.219545 Jul 29 06:27:16.182342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 53/114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:15 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:16.185726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:16.186287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:16.187750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:16.188288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:16.235943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:16.237813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:16.245899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:16.247468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:16.248686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:16.250698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:16.394684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:16.409310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f7d6db4a-92ef-48e2-ae52-b46172b9ac66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.235685 Jul 29 06:27:16.410307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 62/115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:16 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:16.474333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:16.483114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:16.485349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:16.486467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a524739c-7cf9-4b66-8a17-554f62a749db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.256826 Jul 29 06:27:16.487036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 54/116] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:17.205382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:17.206001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:17.213128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:17.213583 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:17.214365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:17.214808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:17.346714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:17.354228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3ecca1cc-5160-4162-a8be-5e37d79be548 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.154982 Jul 29 06:27:17.354799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 63/117] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:17 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:17.431534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:17.432140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:17.438816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:17.439269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:17.440027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:17.440456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:17.513691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:17.514394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:17.521159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:17.521731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:17.522627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:17.523193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:17.577723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:17.585957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e38fc13d-9c80-4acf-8461-0c79947e0d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.158642 Jul 29 06:27:17.587235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 55/118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:17 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:17.673867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:17.682758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:17.684260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:17.685414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7d8c7d9-00c4-4372-94d7-f4fc1fa12de6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.176899 Jul 29 06:27:17.686002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 64/119] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:18.374440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:18.375071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:18.381195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:18.381647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:18.382410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:18.382850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:18.521221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:18.528473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c124cde-f659-4ffe-842c-cce31b0aef65 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.157877 Jul 29 06:27:18.529105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 56/120] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:18 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:18.607210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:18.607857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:18.614653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:18.615107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:18.615873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:18.616315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:18.707231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:18.708203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:18.714242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:18.714800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:18.715580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:18.716022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:18.745301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:18.752884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-264de5d6-0fd3-4a2c-bc23-57dd925f9003 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.149451 Jul 29 06:27:18.753566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 65/121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:18 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:18.849326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:18.857121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:18.858623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:18.860379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b1c89699-4b09-4519-90dd-cce6f977d21b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.156568 Jul 29 06:27:18.861011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 57/122] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:19.553187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:19.554537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:19.564192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:19.565586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:19.567903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:19.568800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:19.756891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:19.765137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-068e71e9-0c94-4f4b-8407-85491c349d4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.218747 Jul 29 06:27:19.766449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 66/123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:19 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:19.773510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:19.774126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:19.780146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:19.780629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:19.781941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:19.782394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:19.886288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:19.886898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:19.893476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:19.893922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:19.894684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:19.895120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:19.919287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:19.927183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d008b02-00e4-4650-b8d3-fae451be663f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.157646 Jul 29 06:27:19.927756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 58/124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:19 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:20.029204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:20.037682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:20.039200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:20.040319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7665eeb0-5914-4a33-bed3-dbb3872fca2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.158325 Jul 29 06:27:20.040921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 67/125] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:20.649277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97fbf890-91cd-4277-8d12-6cd91c414a7f"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:20.651650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:20.657814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:20.658262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:20.659018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:20.659448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:20.788362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:20.789686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:20.796201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:20.797402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:20.798355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:20.798794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:20.937851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:20.947333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dfbf7446-1676-4b6d-8d91-e11033066ab9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.162789 Jul 29 06:27:20.960564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 68/126] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:20 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:20.960564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:20.960564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:20.965901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:20.966535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:20.967494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:20.968163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:21.130286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:21.141012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-145d85f4-4335-47ac-86c1-4dc50d8035b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.190556 Jul 29 06:27:21.142213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 69/127] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:20 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:21.147653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:21.148334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:21.155533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:21.155993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:21.157367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:21.157847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:21.321461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:21.330243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:21.331813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:21.333225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bcb8641d-b0c7-47b3-97ed-0d30ef182682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.189402 Jul 29 06:27:21.333811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 70/128] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:21.591111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-17cac6bb-2414-4ff1-9196-5eaa04b9704c tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "POST /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.945558 Jul 29 06:27:21.592450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 59/129] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 06:27:20 2022] POST /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:21.821700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-544c8c1e-75ce-4f3d-9600-9e346699b3c9 req-bbfc828c-816c-48fd-ac2c-339f89d13008 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65", "name": "network-vif-plugged", "status": "completed", "tag": "c4cfd182-fc76-4e2f-8b38-5663e698a6ba"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:21.836472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-544c8c1e-75ce-4f3d-9600-9e346699b3c9 req-bbfc828c-816c-48fd-ac2c-339f89d13008 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:21.837405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-544c8c1e-75ce-4f3d-9600-9e346699b3c9 req-bbfc828c-816c-48fd-ac2c-339f89d13008 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:21.857186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-544c8c1e-75ce-4f3d-9600-9e346699b3c9 req-bbfc828c-816c-48fd-ac2c-339f89d13008 service nova] Creating event network-vif-plugged:c4cfd182-fc76-4e2f-8b38-5663e698a6ba for instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 on hv-cinder-83482 Jul 29 06:27:21.863863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-544c8c1e-75ce-4f3d-9600-9e346699b3c9 req-bbfc828c-816c-48fd-ac2c-339f89d13008 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045511 Jul 29 06:27:21.865228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 71/130] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:21.983443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:21.986594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:21.994786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:21.995741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:21.996527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:21.997062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:22.163956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:22.165113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:22.172717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:22.173371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:22.174339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:22.174959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:22.200263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:22.209329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d07f05d-dafb-4194-9791-fc204baf69de tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.241753 Jul 29 06:27:22.210128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 60/131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:21 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:22.318252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:22.326013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-855aa319-2af7-4222-9951-77513728b273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.166245 Jul 29 06:27:22.326578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 72/132] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:22 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:22.356449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:22.357083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:22.364477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:22.365203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:22.365970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:22.366399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:22.511137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:22.519755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:22.521320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:22.522427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0543fe0f-fe1b-435e-9770-b38caad707c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.170087 Jul 29 06:27:22.523021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 61/133] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:23.231521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:23.232276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:23.238632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:23.239161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:23.240356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:23.243559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:23.347800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:23.348413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:23.355272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:23.355726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:23.356712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:23.357154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:23.376644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:23.384381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:23.392955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0a115077-027b-4f70-9e5f-009fb2043abe tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.165187 Jul 29 06:27:23.393788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 73/134] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:23 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:23.494710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:23.503344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9968b556-a73c-4429-8cb4-35f7653c1fad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.160174 Jul 29 06:27:23.503926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 62/135] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:23 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:23.546387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:23.548170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:23.554292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:23.554745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:23.555683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:23.556245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:23.696643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:23.704810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:23.706460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:23.708033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b1397c3e-9e9c-482a-8506-e9ee2e6520ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.165398 Jul 29 06:27:23.720896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 74/136] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:24.414433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:24.415072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:24.417329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=92 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:24.423499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:24.424193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:24.425474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:24.425474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:24.525775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:24.526637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:24.535161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:24.535645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:24.536409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:24.537315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:24.574345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:24.582221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c6c42a0-af9e-4976-b8a3-46ef59e62593 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.171539 Jul 29 06:27:24.583539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 63/137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:24 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:24.671229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:24.679729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-961fb1e8-df71-4322-bba0-2a3c7777a6cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.159153 Jul 29 06:27:24.680298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 75/138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:24 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:24.730603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:24.731330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:24.737556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:24.737996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:24.738760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:24.739187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:24.867110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:24.876305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:24.877856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:24.878958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-061e364c-d15b-4c74-8a13-89c0ce888434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.152603 Jul 29 06:27:24.879510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 64/139] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:25.602691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:25.603252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:25.610880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.612291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:25.613501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.613706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:25.618174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:25.701384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:25.702971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:25.711016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.711685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:25.712881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.713573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:25.760338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:25.770210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c31cb48c-766a-492c-b802-72dfbf492a79 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.171213 Jul 29 06:27:25.771245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 76/140] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:25 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:25.780179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-365469bd-ce3f-4f38-a79e-565a33c533f5 req-64996298-dd83-4277-87d0-af5102afc48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f47fa5-72de-4c83-a201-89fb8435978e", "name": "network-vif-plugged", "status": "completed", "tag": "f24af601-0f43-41c4-bb28-56b5a48554aa"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:25.795009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-365469bd-ce3f-4f38-a79e-565a33c533f5 req-64996298-dd83-4277-87d0-af5102afc48a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.795962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-365469bd-ce3f-4f38-a79e-565a33c533f5 req-64996298-dd83-4277-87d0-af5102afc48a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:25.810681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-365469bd-ce3f-4f38-a79e-565a33c533f5 req-64996298-dd83-4277-87d0-af5102afc48a service nova] Creating event network-vif-plugged:f24af601-0f43-41c4-bb28-56b5a48554aa for instance c0f47fa5-72de-4c83-a201-89fb8435978e on hv-cinder-83482 Jul 29 06:27:25.816204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-365469bd-ce3f-4f38-a79e-565a33c533f5 req-64996298-dd83-4277-87d0-af5102afc48a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040162 Jul 29 06:27:25.817293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 77/141] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:25.884075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:25.893374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5edfdcba-86ff-48f2-98c3-b305ba4c8f66 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1321 microversion: 2.1 time: 0.195975 Jul 29 06:27:25.894538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 65/142] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:25 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:25.910172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:25.911081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:25.918305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.919004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:25.919948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:25.920586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:26.075245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:26.091979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:26.094586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:26.095991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d5d00d9-7faa-4b1a-8f2d-9a81a050e229 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.192103 Jul 29 06:27:26.096647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 78/143] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:26.791538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:26.792150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:26.799189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:26.799722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:26.800483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:26.800944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:26.918539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:26.919149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:26.928602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:26.929286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:26.930221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:26.930836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:26.945418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:26.964733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f012a144-b874-474a-b867-90c61a32521e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.173272 Jul 29 06:27:26.965396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 66/144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:26 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:27.104398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:27.112235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6e1f55ad-0561-48ad-9b5f-d27365608940 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1516 microversion: 2.1 time: 0.198241 Jul 29 06:27:27.113862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 79/145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:26 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1516 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:27.135159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:27.135805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:27.142694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:27.145366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:27.151782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.152316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.153312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.153899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.155055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.155504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.156940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.157540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.225061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lazy-loading 'flavor' on Instance uuid 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:27:27.323898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:27.347678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:27.350305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:27.352163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2670ff01-3660-474a-9a97-cd4068ef360f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.221822 Jul 29 06:27:27.353998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 67/146] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:27.369567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6da0419f-7e48-4e1c-b5e8-faeae133b005 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65/action" status: 200 len: 32 microversion: 2.1 time: 0.231524 Jul 29 06:27:27.370346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 80/147] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:27:27 2022] POST /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65/action => generated 32 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 06:27:27.380333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:27.383089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:27.390855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.392104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.393836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.394444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.571350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:27.593495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e02fb53b-6aec-4975-8305-71a0d59684c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.214906 Jul 29 06:27:27.595198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 68/148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:27 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:27.843253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-6190d8ba-9f72-4810-b764-a890e87438e0 req-ce795baa-a5f0-4af8-a350-0104a09b1ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "name": "network-vif-plugged", "status": "completed", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:27.866534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-6190d8ba-9f72-4810-b764-a890e87438e0 req-ce795baa-a5f0-4af8-a350-0104a09b1ae9 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:27.867211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-6190d8ba-9f72-4810-b764-a890e87438e0 req-ce795baa-a5f0-4af8-a350-0104a09b1ae9 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:27.879925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-6190d8ba-9f72-4810-b764-a890e87438e0 req-ce795baa-a5f0-4af8-a350-0104a09b1ae9 service nova] Creating event network-vif-plugged:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:27:27.885098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-6190d8ba-9f72-4810-b764-a890e87438e0 req-ce795baa-a5f0-4af8-a350-0104a09b1ae9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046254 Jul 29 06:27:27.886071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 81/149] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:27.986628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:27.987308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:27.998908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:28.002951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:28.003764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:28.004209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:28.256145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:28.264238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3320ea7f-e6b9-4796-9876-812bc28e79c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1364 microversion: 2.1 time: 0.282066 Jul 29 06:27:28.264865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 69/150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:27 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:28.376194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:28.376932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:28.383691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:28.384136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:28.385092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:28.385535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:28.536922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:28.547309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:28.549177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:28.551058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1e3893e2-e40f-420d-a86d-e41e723879b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.179614 Jul 29 06:27:28.552222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 82/151] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:28.617461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:28.618176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:28.624157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:28.624664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:28.625778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:28.626222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:28.835775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:28.844013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-07477ff3-0335-4067-a941-90734acdf6ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.230491 Jul 29 06:27:28.848742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 70/152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:28 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:29.286338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:29.287008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:29.304799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.305534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.308389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.312931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.496679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:29.506201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9078c99-0a81-4054-92e6-2fe3f8c27482 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1550 microversion: 2.1 time: 0.223788 Jul 29 06:27:29.507004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 83/153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:29 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1550 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:29.528109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:29.528109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:29.534634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.535080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.536049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.536514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.576347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:29.577076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:29.585386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.586086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.586853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.587285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.631376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2748ab5-541e-4d24-9e11-dc7c6ff257ba tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106783 Jul 29 06:27:29.632047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 71/154] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 06:27:29 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:29.738832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:29.749218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:29.751841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:29.753090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-652e9f73-cad5-463b-8bc8-dabe64aaf4db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.181182 Jul 29 06:27:29.753869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 84/155] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:27:29.866658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:29.867562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:29.874509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.875876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:29.876786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:29.877329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:30.314494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:30.328784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-32938695-3bca-4a56-b978-79d9ee110b79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.466366 Jul 29 06:27:30.329953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 72/156] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:29 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:30.777705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:30.778369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:30.795443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:30.796991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:30.798000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:30.804682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:31.019959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:31.029651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:31.031703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:31.037009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4bba4d9b-098d-44cd-9067-a1797b3f6d51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1406 microversion: 2.20 time: 0.261915 Jul 29 06:27:31.038368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 85/157] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1406 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:31.353995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:31.355335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:31.362543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:31.363250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:31.364115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:31.364675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:31.578433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-98845c66-f745-420b-9957-192ace2e75fc req-7b1ce497-63c6-4d42-92b1-82b737fce498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0f47fa5-72de-4c83-a201-89fb8435978e", "tag": "f24af601-0f43-41c4-bb28-56b5a48554aa"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:31.605156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-98845c66-f745-420b-9957-192ace2e75fc req-7b1ce497-63c6-4d42-92b1-82b737fce498 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:31.608869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:31.616606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-98845c66-f745-420b-9957-192ace2e75fc req-7b1ce497-63c6-4d42-92b1-82b737fce498 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:31.618361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-205d17da-096e-44c6-8826-9e4faf080395 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.268764 Jul 29 06:27:31.621734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 73/158] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:31 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:31.644046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-98845c66-f745-420b-9957-192ace2e75fc req-7b1ce497-63c6-4d42-92b1-82b737fce498 service nova] Creating event network-changed:f24af601-0f43-41c4-bb28-56b5a48554aa for instance c0f47fa5-72de-4c83-a201-89fb8435978e on hv-cinder-83482 Jul 29 06:27:31.652149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-98845c66-f745-420b-9957-192ace2e75fc req-7b1ce497-63c6-4d42-92b1-82b737fce498 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080602 Jul 29 06:27:31.653461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 86/159] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:27:32.064849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:32.065469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:32.073799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:32.074428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:32.075529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:32.076404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:32.270364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:32.283785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:32.285424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:32.288284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-65993c96-c4a7-441d-ae53-ad6756881178 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1598 microversion: 2.20 time: 0.228581 Jul 29 06:27:32.289278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 74/160] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:27:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1598 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:27:32.315707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:32.316293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:32.326813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:32.328692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:32.332205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:32.334525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:32.335295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:32.486573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4e09af20-e73b-40b1-9e15-bebb4aa6d590 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.175548 Jul 29 06:27:32.487499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 87/161] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Jul 29 06:27:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-interface => generated 284 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:27:32.643410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:32.644033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:32.658727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:32.659410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:32.660664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:32.663112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:33.076212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:33.084918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f5b4993b-8b5b-4522-a4ea-a0109e2262c1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.446876 Jul 29 06:27:33.085794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 75/162] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:32 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:34.007485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-f1525211-072f-401b-9a42-a12701d63337 req-c5a5d73e-47ea-41c1-8488-d7c86446b1ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:34.017092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-f1525211-072f-401b-9a42-a12701d63337 req-c5a5d73e-47ea-41c1-8488-d7c86446b1ab service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:34.017795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-f1525211-072f-401b-9a42-a12701d63337 req-c5a5d73e-47ea-41c1-8488-d7c86446b1ab service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:34.030457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-f1525211-072f-401b-9a42-a12701d63337 req-c5a5d73e-47ea-41c1-8488-d7c86446b1ab service nova] Creating event network-changed:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:27:34.036020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-f1525211-072f-401b-9a42-a12701d63337 req-c5a5d73e-47ea-41c1-8488-d7c86446b1ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032133 Jul 29 06:27:34.036645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 88/163] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:34.110012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:34.110683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:34.123732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:34.125112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:34.126212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:34.129084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:34.293038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:34.302499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5bfa2dff-c6f2-4966-bce9-55528969f611 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.196876 Jul 29 06:27:34.303268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 76/164] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:34 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:35.324745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:35.325650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:35.332521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:35.333336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:35.334272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:35.334799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:35.474533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:35.482066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b962f803-94f7-4822-b7b7-558e0e5a2f41 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.161562 Jul 29 06:27:35.482635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 89/165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:35 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:36.505562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:36.507056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:36.520666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:36.523520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:36.524335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:36.532054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:36.828874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:36.842347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-49f93ef4-ea7c-42bc-9324-a013df7fcce4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.341621 Jul 29 06:27:36.842983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 77/166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:36 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:37.018876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:37.019449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:37.026596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:37.027127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:37.028058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:37.028731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:37.057299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:27:37.195269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-49a844d6-16ba-447a-ab4f-3784e47ede78 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 204 len: 0 microversion: 2.1 time: 0.181181 Jul 29 06:27:37.197500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 90/167] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:27:37 2022] DELETE /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:27:37.206095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:37.206942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:37.218096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:37.218767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:37.219522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:37.220114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:37.412321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:37.424922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d42a3146-8703-439e-ae4e-ff0d932b712d tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1555 microversion: 2.1 time: 0.222653 Jul 29 06:27:37.427052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 78/168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:37 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:37.865034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:37.865732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:37.872018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:37.872475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:37.873266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:37.873868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:38.322417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:38.330366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2cc671c5-a54b-4e75-b0aa-e759704f48b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.469654 Jul 29 06:27:38.330900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 91/169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:37 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:38.453214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:38.453839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:38.462159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:38.462613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:38.463420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:38.464033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:38.484454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:38.684714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:38.694734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8800c61-422b-4313-ba79-76f1bfd81829 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1555 microversion: 2.1 time: 0.246254 Jul 29 06:27:38.695851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 79/170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:38 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1555 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:39.353759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:39.355045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:39.362207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:39.363053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:39.363972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:39.364588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:39.386366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:39.555733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:39.569434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0ad26e8a-d21b-41f4-9d67-921eb366e76b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.221031 Jul 29 06:27:39.571681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 92/171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:39 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:39.738665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:39.740733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:39.755380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:39.756802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:39.758428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:39.759085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:40.035663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:40.047773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fcb78d81-cdcc-4962-bba4-a59d1dd7e6b1 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1555 microversion: 2.1 time: 0.327877 Jul 29 06:27:40.048778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 80/172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:39 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1555 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:40.282718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-6d63098a-90a4-4860-b9d3-08de9f1ae451 req-41a91f71-b727-4fd4-9213-f5ffdf5f7db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "accf1ede-e9d8-416c-b579-97df69af233d", "name": "network-vif-deleted", "tag": "47884efd-6341-439f-8e11-76bf83432aa4"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:40.293202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-6d63098a-90a4-4860-b9d3-08de9f1ae451 req-41a91f71-b727-4fd4-9213-f5ffdf5f7db1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:40.293766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-6d63098a-90a4-4860-b9d3-08de9f1ae451 req-41a91f71-b727-4fd4-9213-f5ffdf5f7db1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:40.333528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-6d63098a-90a4-4860-b9d3-08de9f1ae451 req-41a91f71-b727-4fd4-9213-f5ffdf5f7db1 service nova] Creating event network-vif-deleted:47884efd-6341-439f-8e11-76bf83432aa4 for instance accf1ede-e9d8-416c-b579-97df69af233d on hv-cinder-83482 Jul 29 06:27:40.347386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-6d63098a-90a4-4860-b9d3-08de9f1ae451 req-41a91f71-b727-4fd4-9213-f5ffdf5f7db1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064601 Jul 29 06:27:40.348039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 93/173] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:40.591035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:40.591730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:40.599476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:40.599969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:40.601437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:40.601707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:40.781021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:40.790915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3e796e5a-71e2-4111-b16c-c61e9f6aad68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.203846 Jul 29 06:27:40.791892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 81/174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:40 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:41.074676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:41.076480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:41.087329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:41.088095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:41.089405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:41.090732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:41.130274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:41.130823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:41.131377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lazy-loading 'fault' on Instance uuid accf1ede-e9d8-416c-b579-97df69af233d {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:27:41.192862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1e3dde3b1fd48f89f553ccf1dc76a13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ed8bbfcf5ec4f74baf644f4a9d5f200', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:41.201769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-99f21269-be55-4446-bf55-26a63fa5f039 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 200 len: 1351 microversion: 2.1 time: 0.133709 Jul 29 06:27:41.203684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 94/175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:41 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:41.817472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:41.818514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:41.829474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:41.830375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:41.831342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:41.831922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:42.147095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:42.154909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1aaa5955-5a5f-4f22-a097-41ac0d1b8a15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.344276 Jul 29 06:27:42.156519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 82/176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:41 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:42.233345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:42.234863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:42.243618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:42.244503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:42.245549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:42.246225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:42.263747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] HTTP exception thrown: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Request method failure captured: Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d HTTP/1.1 Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432WXO4KuMeJlfH5ZI6svBS7xekEAzi8-7fajTPtA12UxrrO9pLnhgOd7kuwhf-LEF9LOsrRV6XzV7HbfzebvzNoDZvW6flbn8E9kBRoRUo2taND1LQWVTEsEuBCYHTzak8qkW_vv-wFfcU00SWP8RxLUccFFWfO6O84k_GxVU8hzCM Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:27:42.270664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5ed8bbfcf5ec4f74baf644f4a9d5f200", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: d1e3dde3b1fd48f89f553ccf1dc76a13 Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.271940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'accf1ede-e9d8-416c-b579-97df69af233d'} Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:42.272655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.273781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.274719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Returning 404 to user: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:42.274719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8d388a0-6e64-4d65-aa9a-e1c4a88a9cb6 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 404 len: 111 microversion: 2.1 time: 0.045527 Jul 29 06:27:42.275807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 95/177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:42 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:27:42.494655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:42.497416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:42.505323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:42.506097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:42.507180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:42.507797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:42.525557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] HTTP exception thrown: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Request method failure captured: Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d/os-volume_attachments HTTP/1.1 Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432WXO4KuMeJlfH5ZI6svBS7xekEAzi8-7fajTPtA12UxrrO9pLnhgOd7kuwhf-LEF9LOsrRV6XzV7HbfzebvzNoDZvW6flbn8E9kBRoRUo2taND1LQWVTEsEuBCYHTzak8qkW_vv-wFfcU00SWP8RxLUccFFWfO6O84k_GxVU8hzCM Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:27:42.549733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5ed8bbfcf5ec4f74baf644f4a9d5f200", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: d1e3dde3b1fd48f89f553ccf1dc76a13 Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.551003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'server_id': 'accf1ede-e9d8-416c-b579-97df69af233d'} Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:42.551754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:42.553555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:42.554603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Returning 404 to user: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:42.554603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-694c9ca9-6319-4967-9ae0-1a9bc074e21b tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061026 Jul 29 06:27:42.554603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 83/178] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:27:42 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:27:43.180643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:43.181337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:43.198739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:43.201565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:43.203844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:43.204377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:43.478468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:43.491553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9a3409ba-8dbf-4944-89a9-40af20f563d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.315350 Jul 29 06:27:43.507067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 96/179] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:43 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:43.861201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:43.862336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:43.870245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:43.870694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:43.871756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:43.872282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:43.887259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] HTTP exception thrown: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Request method failure captured: Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d HTTP/1.1 Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432WXO4KuMeJlfH5ZI6svBS7xekEAzi8-7fajTPtA12UxrrO9pLnhgOd7kuwhf-LEF9LOsrRV6XzV7HbfzebvzNoDZvW6flbn8E9kBRoRUo2taND1LQWVTEsEuBCYHTzak8qkW_vv-wFfcU00SWP8RxLUccFFWfO6O84k_GxVU8hzCM Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:27:43.889909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5ed8bbfcf5ec4f74baf644f4a9d5f200", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: d1e3dde3b1fd48f89f553ccf1dc76a13 Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.891229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'accf1ede-e9d8-416c-b579-97df69af233d'} Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:43.891897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.893012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.894353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Returning 404 to user: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:43.895255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4dd99285-ca20-46d6-a806-256475918dde tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "DELETE /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 404 len: 111 microversion: 2.1 time: 0.041383 Jul 29 06:27:43.898872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 84/180] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:27:43 2022] DELETE /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:27:43.904498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:43.905254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] [instance: accf1ede-e9d8-416c-b579-97df69af233d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:43.911961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:43.912752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:43.913594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:43.914087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:43.931079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] HTTP exception thrown: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Request method failure captured: Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d HTTP/1.1 Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432WXO4KuMeJlfH5ZI6svBS7xekEAzi8-7fajTPtA12UxrrO9pLnhgOd7kuwhf-LEF9LOsrRV6XzV7HbfzebvzNoDZvW6flbn8E9kBRoRUo2taND1LQWVTEsEuBCYHTzak8qkW_vv-wFfcU00SWP8RxLUccFFWfO6O84k_GxVU8hzCM Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:27:43.932913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5ed8bbfcf5ec4f74baf644f4a9d5f200", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5ed8bbfcf5ec4f74baf644f4a9d5f200"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 5ed8bbfcf5ec4f74baf644f4a9d5f200 Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-DeleteServersTestJSON-815291525 Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: d1e3dde3b1fd48f89f553ccf1dc76a13 Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-DeleteServersTestJSON-815291525-project Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.934321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'accf1ede-e9d8-416c-b579-97df69af233d'} Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:43.935005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. Jul 29 06:27:43.936520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:43.937638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] Returning 404 to user: Instance accf1ede-e9d8-416c-b579-97df69af233d could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:43.937638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9541ea86-ae1e-4fa4-bc9e-1be0c441def2 tempest-DeleteServersTestJSON-815291525 tempest-DeleteServersTestJSON-815291525-project] 10.222.0.33 "GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d" status: 404 len: 111 microversion: 2.1 time: 0.034013 Jul 29 06:27:43.937638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 97/181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:43 2022] GET /compute/v2.1/servers/accf1ede-e9d8-416c-b579-97df69af233d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:27:44.516843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:44.517723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:44.525500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:44.526211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:44.527825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:44.528451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:44.700455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:44.710644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9fb6d402-5011-4b0c-bb87-dca2e7ef1dd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.198474 Jul 29 06:27:44.711256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 85/182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:44 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:45.021439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1820644004", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "networks": [{"uuid": "0ed2239d-a249-40d0-a058-0da3464a2e1b"}]}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:45.114682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] validate_networks() for [('0ed2239d-a249-40d0-a058-0da3464a2e1b', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:27:45.736824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:45.738339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:45.751541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:45.752852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:45.753658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:45.754104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:45.944873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:45.954819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c8bc317-e55e-4a1c-96ce-551103b46221 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.225554 Jul 29 06:27:45.955908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 86/183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:45 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:45.983261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:27:45.983847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:27:45.984382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:27:45.984907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:27:45.985395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:27:45.995936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:45.996640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:45.997756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:45.998395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:46.017960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Getting quotas for project c241dc0f043e46c8a01503a1c343abf9. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:27:46.023013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Getting quotas for user 55bb264bd9834f5fa61b58362ec48d31 and project c241dc0f043e46c8a01503a1c343abf9. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:27:46.036942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:27:46.039914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:27:46.098756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ba1056f9-d8a3-491c-9013-943e924a1f59 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.080966 Jul 29 06:27:46.099903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 98/184] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:27:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1083 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:27:46.117552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4691f465-fd00-4ffc-af90-e723bff9fa84 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:46.118456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4691f465-fd00-4ffc-af90-e723bff9fa84 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:46.222548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4691f465-fd00-4ffc-af90-e723bff9fa84 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:46.242092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4691f465-fd00-4ffc-af90-e723bff9fa84 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1214 microversion: 2.1 time: 0.133271 Jul 29 06:27:46.242862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 87/185] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:46 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:46.979562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:46.981028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:46.996422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:46.997010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:46.997889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:46.998451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:47.210043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:47.222227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8c30dfb0-8347-4562-9795-a707f9279636 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.249867 Jul 29 06:27:47.229237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 99/186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:46 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:47.265215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:47.265955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:47.275128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:47.276097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:47.278456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:47.281464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:47.506376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:47.529865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ab9abff-1439-41a1-9de7-72965d33a726 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1266 microversion: 2.1 time: 0.270325 Jul 29 06:27:47.531052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 88/187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:47 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:48.255305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:48.256505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:48.266166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:48.266875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:48.267835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:48.268271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:48.552654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:48.553269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:48.567191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:48.568154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:48.569182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:48.573972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:48.644808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:48.662588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e14d7693-d1f3-4c03-bfdc-ca4d74d89d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.413784 Jul 29 06:27:48.663222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 100/188] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:48 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:48.675538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:48.690848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-351b96c8-0c68-4862-9390-cd2112a6c795 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1272 microversion: 2.1 time: 0.142153 Jul 29 06:27:48.696381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 89/189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:48 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1272 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:49.689570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:49.690245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:49.708572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:49.713974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:49.715125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:49.719251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:49.720354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:49.720981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:49.731584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:49.734466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:49.737807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:49.740592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:49.971616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:49.979471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2d6060dc-c7cb-4e2c-bb92-ec198c840d8e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.293902 Jul 29 06:27:49.980815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 101/190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:49 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:49.982726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:49.991602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9ff2fcb6-a1b2-40a0-8b5c-1dc6aa42ed2b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.281381 Jul 29 06:27:49.995117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 90/191] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:49 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:50.086424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-5db8658a-0a19-4d4a-b656-48b9a940e21d req-efdf0c3e-6d19-46ce-b649-12ad43a68709 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b97b43e0-86a8-489f-a76a-cd4de89d3b82", "tag": "7a87cb56-7112-49eb-ad37-527683c7f583"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:50.123173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-5db8658a-0a19-4d4a-b656-48b9a940e21d req-efdf0c3e-6d19-46ce-b649-12ad43a68709 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:50.123653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-5db8658a-0a19-4d4a-b656-48b9a940e21d req-efdf0c3e-6d19-46ce-b649-12ad43a68709 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:50.142017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-5db8658a-0a19-4d4a-b656-48b9a940e21d req-efdf0c3e-6d19-46ce-b649-12ad43a68709 service nova] Creating event network-changed:7a87cb56-7112-49eb-ad37-527683c7f583 for instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 on hv-cinder-83482 Jul 29 06:27:50.161044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-5db8658a-0a19-4d4a-b656-48b9a940e21d req-efdf0c3e-6d19-46ce-b649-12ad43a68709 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094875 Jul 29 06:27:50.162124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 102/192] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:50.907052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d379ffe3-57b6-402d-b72b-071a7f962223 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Action: 'create', calling method: .version_select at 0x7f145a466820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1638653597", "metadata": {"Type": "work"}}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d379ffe3-57b6-402d-b72b-071a7f962223 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Request method failure captured: Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 122 Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi433m8jrDJNN2F0MQTQ3DUHk5A6PHyX2inIpRQYouoZEDZtIZ74CYMe_uwsEuHaBjfU-0m5-a8Juq2wk9rLXXyCyrVmsE1Lktt48XLbe5yHMFJYGvuk0C2fPJu7QhtMlCCZCszdsOewdc9_DU08Xo5k36iSdkOpHVv6FOUQxo0ttV5_o Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:27:50.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b68f4eb16e0c4d548c2ee3eb7b03f651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 8558032ae6b947ad957a32aab4c90f3b Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1638653597", "metadata": {"Type": "work"}}} Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: Jul 29 06:27:50.918121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1638653597', 'metadata': {'Type': 'work'}}}} Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise error Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:50.919073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 06:27:50.924741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 06:27:50.926115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 06:27:50.926115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.926115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d379ffe3-57b6-402d-b72b-071a7f962223 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:50.926115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d379ffe3-57b6-402d-b72b-071a7f962223 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.169582 Jul 29 06:27:50.926115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 91/193] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Jul 29 06:27:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:27:50.931144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3bf7f509-be7a-4461-a884-945b028f7fa2 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Action: 'create', calling method: .version_select at 0x7f14594a4c10>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-749402500", "metadata": {"Type": "work"}}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3bf7f509-be7a-4461-a884-945b028f7fa2 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Request method failure captured: Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 119 Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi433m8jrDJNN2F0MQTQ3DUHk5A6PHyX2inIpRQYouoZEDZtIZ74CYMe_uwsEuHaBjfU-0m5-a8Juq2wk9rLXXyCyrVmsE1Lktt48XLbe5yHMFJYGvuk0C2fPJu7QhtMlCCZCszdsOewdc9_DU08Xo5k36iSdkOpHVv6FOUQxo0ttV5_o Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:27:50.936424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b68f4eb16e0c4d548c2ee3eb7b03f651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 8558032ae6b947ad957a32aab4c90f3b Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-749402500", "metadata": {"Type": "work"}}} Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:27:50.937789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-749402500', 'metadata': {'Type': 'work'}}}} Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise error Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi '0' Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:50.938626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 06:27:50.939882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 06:27:50.941032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 06:27:50.941032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.942043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3bf7f509-be7a-4461-a884-945b028f7fa2 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:50.943205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3bf7f509-be7a-4461-a884-945b028f7fa2 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016162 Jul 29 06:27:50.944188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 103/194] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Jul 29 06:27:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:27:50.953606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9dab7b76-24a4-4d7f-befd-866620b237f9 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Action: 'create', calling method: .version_select at 0x7f145a479430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1717005048", "metadata": {"Type": "work"}}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9dab7b76-24a4-4d7f-befd-866620b237f9 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Request method failure captured: Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 119 Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi433m8jrDJNN2F0MQTQ3DUHk5A6PHyX2inIpRQYouoZEDZtIZ74CYMe_uwsEuHaBjfU-0m5-a8Juq2wk9rLXXyCyrVmsE1Lktt48XLbe5yHMFJYGvuk0C2fPJu7QhtMlCCZCszdsOewdc9_DU08Xo5k36iSdkOpHVv6FOUQxo0ttV5_o Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:27:50.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b68f4eb16e0c4d548c2ee3eb7b03f651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 8558032ae6b947ad957a32aab4c90f3b Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1717005048", "metadata": {"Type": "work"}}} Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: Jul 29 06:27:50.959883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1717005048', 'metadata': {'Type': 'work'}}}} Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise error Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi '' Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:50.961256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 06:27:50.963002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 06:27:50.972442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 06:27:50.972442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:50.972442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9dab7b76-24a4-4d7f-befd-866620b237f9 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:50.972442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9dab7b76-24a4-4d7f-befd-866620b237f9 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017297 Jul 29 06:27:50.973232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 92/195] 10.222.0.33 () {60 vars in 1156 bytes} [Fri Jul 29 06:27:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:27:50.978904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb87046b-9ab1-4466-9719-bfef13b8888b tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Calling method '.version_select at 0x7f14593bf160>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:51.002771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:51.003587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:51.010556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:51.011023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:51.011800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:51.012237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:51.014562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-cb87046b-9ab1-4466-9719-bfef13b8888b tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] HTTP exception thrown: Volume tempest-invalid-1810562165 could not be found. Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb87046b-9ab1-4466-9719-bfef13b8888b tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Request method failure captured: Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1810562165 HTTP/1.1 Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi433m8jrDJNN2F0MQTQ3DUHk5A6PHyX2inIpRQYouoZEDZtIZ74CYMe_uwsEuHaBjfU-0m5-a8Juq2wk9rLXXyCyrVmsE1Lktt48XLbe5yHMFJYGvuk0C2fPJu7QhtMlCCZCszdsOewdc9_DU08Xo5k36iSdkOpHVv6FOUQxo0ttV5_o Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:27:51.017102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b68f4eb16e0c4d548c2ee3eb7b03f651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 8558032ae6b947ad957a32aab4c90f3b Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Volume tempest-invalid-1810562165 could not be found. Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'tempest-invalid-1810562165'} Jul 29 06:27:51.018233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1810562165 could not be found. (HTTP 404) (Request-ID: req-86896aa8-da10-4bde-b43c-225b701da07e) Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.018917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 06:27:51.019915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1810562165 could not be found. Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:51.021013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1810562165 could not be found. Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1810562165 could not be found. Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb87046b-9ab1-4466-9719-bfef13b8888b tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Returning 404 to user: Volume tempest-invalid-1810562165 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cb87046b-9ab1-4466-9719-bfef13b8888b tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1810562165" status: 404 len: 99 microversion: 2.1 time: 0.044987 Jul 29 06:27:51.022031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 104/196] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Jul 29 06:27:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1810562165 => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 29 06:27:51.025975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:51.026758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:51.034483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:51.035022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:51.035654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:51.036091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:51.237415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:51.245706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4fc3c63e-7c6a-44a9-b76b-05111e4a984e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.247497 Jul 29 06:27:51.260563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 93/197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:50 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:51.263081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06c30a8b-5a76-41a7-ac37-4061e538200b tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006546 Jul 29 06:27:51.280651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 94/198] 10.222.0.33 () {58 vars in 1140 bytes} [Fri Jul 29 06:27:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 06:27:51.287111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:51.287691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-798e3278-4314-4e60-8506-aca590c5a5d1 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005237 Jul 29 06:27:51.288288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 95/199] 10.222.0.33 () {58 vars in 1137 bytes} [Fri Jul 29 06:27:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 06:27:51.296520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5ff8e053-ad1d-41b2-9f1e-97fe0151d7f6 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.275406 Jul 29 06:27:51.300148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66e96f40-e17a-4100-afce-82ed7f6f4995 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Calling method '.version_select at 0x7f145a4790d0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:51.308473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 105/200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:51 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:51.333876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-66e96f40-e17a-4100-afce-82ed7f6f4995 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] HTTP exception thrown: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66e96f40-e17a-4100-afce-82ed7f6f4995 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Request method failure captured: Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/os-volumes/9079451c-d19e-49e3-b950-e4d73a1b5fc6 HTTP/1.1 Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi433m8jrDJNN2F0MQTQ3DUHk5A6PHyX2inIpRQYouoZEDZtIZ74CYMe_uwsEuHaBjfU-0m5-a8Juq2wk9rLXXyCyrVmsE1Lktt48XLbe5yHMFJYGvuk0C2fPJu7QhtMlCCZCszdsOewdc9_DU08Xo5k36iSdkOpHVv6FOUQxo0ttV5_o Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:27:51.337514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b68f4eb16e0c4d548c2ee3eb7b03f651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 8558032ae6b947ad957a32aab4c90f3b Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '9079451c-d19e-49e3-b950-e4d73a1b5fc6'} Jul 29 06:27:51.339146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. (HTTP 404) (Request-ID: req-5906c051-1da9-4b8b-97a2-e2a7351fd058) Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.340117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 06:27:51.341447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 06:27:51.342946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66e96f40-e17a-4100-afce-82ed7f6f4995 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Returning 404 to user: Volume 9079451c-d19e-49e3-b950-e4d73a1b5fc6 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-66e96f40-e17a-4100-afce-82ed7f6f4995 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/9079451c-d19e-49e3-b950-e4d73a1b5fc6" status: 404 len: 109 microversion: 2.1 time: 0.045187 Jul 29 06:27:51.344311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 96/201] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:27:51 2022] DELETE /compute/v2.1/os-volumes/9079451c-d19e-49e3-b950-e4d73a1b5fc6 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 06:27:51.349781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d06f7da4-3d94-49ea-a041-a828cd62e868 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Calling method '.version_select at 0x7f14594a41f0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:51.379453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-d06f7da4-3d94-49ea-a041-a828cd62e868 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] HTTP exception thrown: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d06f7da4-3d94-49ea-a041-a828cd62e868 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Request method failure captured: Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/os-volumes/1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 HTTP/1.1 Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi433m8jrDJNN2F0MQTQ3DUHk5A6PHyX2inIpRQYouoZEDZtIZ74CYMe_uwsEuHaBjfU-0m5-a8Juq2wk9rLXXyCyrVmsE1Lktt48XLbe5yHMFJYGvuk0C2fPJu7QhtMlCCZCszdsOewdc9_DU08Xo5k36iSdkOpHVv6FOUQxo0ttV5_o Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:27:51.381515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_b68f4eb16e0c4d548c2ee3eb7b03f651", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/b68f4eb16e0c4d548c2ee3eb7b03f651"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: b68f4eb16e0c4d548c2ee3eb7b03f651 Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesNegativeTest-1867112304 Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 8558032ae6b947ad957a32aab4c90f3b Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesNegativeTest-1867112304-project Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '1dc4bdd2-5e48-4e71-ad96-cf2511b29e94'} Jul 29 06:27:51.383034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. (HTTP 404) (Request-ID: req-08ac4d69-53f1-499b-ac31-15b783fa42ea) Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.383907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 06:27:51.385176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 06:27:51.387215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d06f7da4-3d94-49ea-a041-a828cd62e868 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] Returning 404 to user: Volume 1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d06f7da4-3d94-49ea-a041-a828cd62e868 tempest-VolumesNegativeTest-1867112304 tempest-VolumesNegativeTest-1867112304-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/1dc4bdd2-5e48-4e71-ad96-cf2511b29e94" status: 404 len: 109 microversion: 2.1 time: 0.037130 Jul 29 06:27:51.388505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 106/202] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 06:27:51 2022] GET /compute/v2.1/os-volumes/1dc4bdd2-5e48-4e71-ad96-cf2511b29e94 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:27:52.279293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:52.281921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:52.309271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:52.316352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:52.317721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:52.318364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:52.343970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:52.345193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:52.358705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:52.359441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:52.360465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:52.361128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:52.588980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:52.598108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b2569d61-3607-4b45-85b4-1e191a3c911b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.262446 Jul 29 06:27:52.598694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 107/203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:52 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:52.616290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:52.627818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-db899d4a-774b-47fd-8355-d9ce68dcbf85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.355911 Jul 29 06:27:52.629773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 97/204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:52 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:53.619152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:53.619708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:53.628238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:53.628238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:53.629203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:53.629416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:53.649215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:53.650008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:53.667614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:53.668272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:53.669284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:53.671684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:53.860896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:53.874543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a72f676e-c924-4dc0-bca6-0aeb39d086d9 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.258449 Jul 29 06:27:53.875194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 108/205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:53 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:53.924063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:53.934869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c383e44-98df-42a1-a775-c7636e10c444 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.289478 Jul 29 06:27:53.935752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 98/206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:53 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:54.895213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:54.895812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:54.901705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:54.902155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:54.902913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:54.903346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:54.957049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:54.958543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:54.961057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=64 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:54.966445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:54.966889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:54.968237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:54.968830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:55.084607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:55.094462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-361d794c-9f46-455c-8ef4-e06f4d4c10b4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.202794 Jul 29 06:27:55.095380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 109/207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:54 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:55.127063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:55.135780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fae62c4a-17b7-4372-b67e-6e0407a81db8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.182790 Jul 29 06:27:55.136355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 99/208] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:54 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:55.655838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-d646b924-0b6a-486e-b09e-8e4c2aa28e35 req-0ca4c7a1-4ae3-41ec-8135-1c84db171058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97b43e0-86a8-489f-a76a-cd4de89d3b82", "name": "network-vif-plugged", "status": "completed", "tag": "7a87cb56-7112-49eb-ad37-527683c7f583"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:27:55.666014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-d646b924-0b6a-486e-b09e-8e4c2aa28e35 req-0ca4c7a1-4ae3-41ec-8135-1c84db171058 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:55.666529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-d646b924-0b6a-486e-b09e-8e4c2aa28e35 req-0ca4c7a1-4ae3-41ec-8135-1c84db171058 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:55.678404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-d646b924-0b6a-486e-b09e-8e4c2aa28e35 req-0ca4c7a1-4ae3-41ec-8135-1c84db171058 service nova] Creating event network-vif-plugged:7a87cb56-7112-49eb-ad37-527683c7f583 for instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 on hv-cinder-83482 Jul 29 06:27:55.683311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-d646b924-0b6a-486e-b09e-8e4c2aa28e35 req-0ca4c7a1-4ae3-41ec-8135-1c84db171058 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031653 Jul 29 06:27:55.683899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 110/209] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:27:56.116419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:56.117068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:56.124823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:56.124823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:56.125582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:56.126020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:56.154824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:56.155798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:56.159799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:56.160597 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:56.167829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:56.168433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:56.169254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:56.169685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:56.238155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:56.271901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:56.281534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-98b2fc9c-bf6a-4d92-be3c-57b762b5cfbc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.169039 Jul 29 06:27:56.282182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 100/210] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:56 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:56.333068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:56.340600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0af1a770-1822-405c-9b6d-4c7660768f3a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.186680 Jul 29 06:27:56.341166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 111/211] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:56 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:57.302306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:57.302918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:57.309459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:57.309906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:57.310660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:57.311591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:57.362167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:57.362779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:57.369142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:57.369593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:57.370362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:57.370799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:57.446905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:57.454545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ab8cbf1c-8152-4bec-bebe-3564a1241deb tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.155952 Jul 29 06:27:57.455111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 101/212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:57 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:57.504250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:57.511757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c566603-d646-462c-b323-05197a60c547 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.153947 Jul 29 06:27:57.512319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 112/213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:57 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:58.475358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:58.475966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:58.482567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:58.483217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:58.484015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:58.484454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:58.533678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:58.534322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:58.540294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:58.540791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:58.541559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:58.542347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:58.629305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:58.636878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5dc8110-3330-4a20-ba68-85967dc8fbec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.165495 Jul 29 06:27:58.637486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 102/214] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:58 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:58.674740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:58.682156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c0ca57c1-3ff0-4f89-9f2b-c977a6188164 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.152484 Jul 29 06:27:58.682720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 113/215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:58 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:27:59.658706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:59.659261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:59.666246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:59.666695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:59.667494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:59.667921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:59.686837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:27:59.703418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:27:59.704225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:27:59.710667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:59.711118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:59.711921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:27:59.712357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:27:59.804016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:59.813716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e444691a-e3ce-4805-af2f-dc88ee4c5dec tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.158857 Jul 29 06:27:59.814292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 103/216] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:59 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:27:59.853218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:27:59.861280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ec9bf1f5-7340-4753-8281-0644715997be tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.162014 Jul 29 06:27:59.861835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 114/217] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:27:59 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:00.835242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:00.835872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:00.843090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:00.843564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:00.844343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:00.844819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:00.882960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:00.883562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:00.890487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:00.891024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:00.891899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:00.892405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:00.908280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:00.979679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:00.990569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0da3d025-5165-4587-ad61-9c75c395781d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1314 microversion: 2.1 time: 0.159301 Jul 29 06:28:00.991253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 104/218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:00 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:01.029396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:01.037431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0adfd89c-21cd-4d59-8d74-1f2a451b7ae6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.158225 Jul 29 06:28:01.037997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 115/219] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:00 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:02.011812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:02.012461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:02.019692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.020274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.021085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.021524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.059303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:02.059934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:02.067196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.067668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.068654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.069123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.165572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:02.173957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5597bf77-79a0-4be5-bdea-e13229280a5d tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1498 microversion: 2.1 time: 0.166084 Jul 29 06:28:02.174539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 105/220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:02 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1498 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:02.205140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:02.213522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ef6ef911-ce67-4b81-b2f0-7ddccee96466 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.158065 Jul 29 06:28:02.214087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 116/221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:02 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:02.700434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:02.701174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:02.709431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.709784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.710556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.710985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.746027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:28:02.859215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-15f1c2b0-ba6b-4d7a-9570-bc99df836621 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 204 len: 0 microversion: 2.1 time: 0.164611 Jul 29 06:28:02.859800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 106/222] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:28:02 2022] DELETE /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:28:02.868506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:02.869123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:02.870975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:02.877188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.877642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:02.878413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:02.878849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:03.011605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:03.019757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-91879f72-b21e-414e-9933-30e054b34c9b tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1504 microversion: 2.1 time: 0.155370 Jul 29 06:28:03.020316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 117/223] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:02 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:03.239794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:03.240763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:03.247630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:03.248076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:03.249424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:03.250107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:03.387315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:03.394748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-294f6100-476a-4479-92d2-9505162992f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.160381 Jul 29 06:28:03.395308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 107/224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:03 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:04.041340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:04.042189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:04.048916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:04.054726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:04.056093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:04.056790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:04.215132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:04.224819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2a6ba673-44b2-4978-9d7e-1b5a2a58856e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1504 microversion: 2.1 time: 0.187222 Jul 29 06:28:04.225707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 118/225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:04 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:04.417203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:04.418467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:04.425783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:04.426231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:04.427306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:04.427845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:04.588617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:04.599812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5b6826f6-dcbf-4a39-aad6-fcfdc465d68a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.186554 Jul 29 06:28:04.600415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 108/226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:04 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:05.249383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:05.250595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:05.257301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:05.257926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:05.259445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:05.260137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:05.276575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-fab7210a-ca24-4b8b-932a-6a1bb66020a9 req-a610af42-a0f8-4647-871a-91650d8adc08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b97b43e0-86a8-489f-a76a-cd4de89d3b82", "name": "network-vif-deleted", "tag": "7a87cb56-7112-49eb-ad37-527683c7f583"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:05.298697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-fab7210a-ca24-4b8b-932a-6a1bb66020a9 req-a610af42-a0f8-4647-871a-91650d8adc08 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:05.299901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-fab7210a-ca24-4b8b-932a-6a1bb66020a9 req-a610af42-a0f8-4647-871a-91650d8adc08 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:05.315166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-fab7210a-ca24-4b8b-932a-6a1bb66020a9 req-a610af42-a0f8-4647-871a-91650d8adc08 service nova] Creating event network-vif-deleted:7a87cb56-7112-49eb-ad37-527683c7f583 for instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 on hv-cinder-83482 Jul 29 06:28:05.320289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-fab7210a-ca24-4b8b-932a-6a1bb66020a9 req-a610af42-a0f8-4647-871a-91650d8adc08 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048377 Jul 29 06:28:05.321223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 109/227] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:05.359143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:05.367228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e8cee425-1d1b-4991-ba48-6cfde16fff8e tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 200 len: 1462 microversion: 2.1 time: 0.122949 Jul 29 06:28:05.378960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 119/228] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:05 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 1462 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:05.623242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:05.624704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:05.631847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:05.632305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:05.633229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:05.633671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:05.780270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:05.789529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9fc77f18-11a0-4bf8-9ee0-261f086593a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.171999 Jul 29 06:28:05.790102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 110/229] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:05 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:06.390678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:06.391859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b97b43e0-86a8-489f-a76a-cd4de89d3b82] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:06.399039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:06.399493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:06.400279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:06.400755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:06.415407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] HTTP exception thrown: Instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 could not be found. Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Request method failure captured: Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 HTTP/1.1 Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi433eK8DNds89jc3WlusH7ByLf0G2UmIoBJmMrT0Kyi1TKERvfgDvwqCFQ7E3EBqmeaB1ygdw2gkeQBn5sz-VtJcNrKuNnnYsKFtUmMD7w0OwhLETpcRFC082VbWE6kp7j9Kb1_6c6y4fzK77tL27MWOh6_hMOjKry_X_dN2YsqDkxIQ Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: c241dc0f043e46c8a01503a1c343abf9 Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesActionsTest-177501211 Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:28:06.417114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c241dc0f043e46c8a01503a1c343abf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c241dc0f043e46c8a01503a1c343abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c241dc0f043e46c8a01503a1c343abf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c241dc0f043e46c8a01503a1c343abf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesActionsTest-177501211 Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: c241dc0f043e46c8a01503a1c343abf9 Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesActionsTest-177501211 Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesActionsTest-177501211-project Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 55bb264bd9834f5fa61b58362ec48d31 Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesActionsTest-177501211-project Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 could not be found. Jul 29 06:28:06.418656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'b97b43e0-86a8-489f-a76a-cd4de89d3b82'} Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 could not be found. Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:28:06.419419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 could not be found. Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 could not be found. Jul 29 06:28:06.421406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:28:06.423143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Returning 404 to user: Instance b97b43e0-86a8-489f-a76a-cd4de89d3b82 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:28:06.423143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-849a3a4d-563b-4d3c-b370-db77c3169e3f tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82" status: 404 len: 111 microversion: 2.1 time: 0.032995 Jul 29 06:28:06.423143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 120/230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:06 2022] GET /compute/v2.1/servers/b97b43e0-86a8-489f-a76a-cd4de89d3b82 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:28:06.529482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-896724074", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "networks": [{"uuid": "0ed2239d-a249-40d0-a058-0da3464a2e1b"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:06.587470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] validate_networks() for [('0ed2239d-a249-40d0-a058-0da3464a2e1b', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:28:06.814039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:06.814734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:06.821042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:06.824382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:06.825450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:06.825988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:06.985185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:28:06.985751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:28:06.986234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:28:06.986645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:28:06.987288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:28:06.997838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:06.998905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:07.000044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:07.000490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:07.005672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:07.013491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fef4c9f3-5cd0-4c82-bb0c-920bbbc1c59a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.204132 Jul 29 06:28:07.014860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 121/231] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:06 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:07.019081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Getting quotas for project c241dc0f043e46c8a01503a1c343abf9. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:28:07.023153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Getting quotas for user 55bb264bd9834f5fa61b58362ec48d31 and project c241dc0f043e46c8a01503a1c343abf9. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:28:07.038218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:28:07.041033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:28:07.093296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9d58e44a-22e7-4342-8eeb-2ce66dd3db69 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569178 Jul 29 06:28:07.093943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 111/232] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 06:28:07.104498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-24c22a30-0965-4ca3-b658-0a6d10545243 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:07.105132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-24c22a30-0965-4ca3-b658-0a6d10545243 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:07.171504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-24c22a30-0965-4ca3-b658-0a6d10545243 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:07.179413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-24c22a30-0965-4ca3-b658-0a6d10545243 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1213 microversion: 2.1 time: 0.078640 Jul 29 06:28:07.180331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 122/233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:07 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:08.035423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:08.036055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:08.043480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:08.043930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:08.044734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:08.046007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:08.200848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:08.201996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:08.212026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:08.212474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:08.213282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:08.213721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:08.286245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:08.295699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b10d2671-b78a-4911-a770-4ecab67c0538 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.264201 Jul 29 06:28:08.297059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 112/234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:08 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:08.355107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:08.366726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ae198b43-d86c-40a8-8fdf-f530edafd1bc tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1273 microversion: 2.1 time: 0.169560 Jul 29 06:28:08.369128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 123/235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:08 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1273 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:09.319250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:09.319862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:09.327257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:09.328081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:09.329068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:09.329569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:09.389768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:09.391195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:09.398138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:09.398510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:09.399324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:09.399961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:09.637530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:09.657661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c270bfb5-ac7e-4832-8b22-693d64890506 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.341209 Jul 29 06:28:09.658950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 113/236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:09 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:09.829851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:09.838971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c3516596-5564-42a3-8e4e-160bf5ba2582 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1313 microversion: 2.1 time: 0.453325 Jul 29 06:28:09.839897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 124/237] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:09 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:10.087772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-218b2ff5-4c45-4809-b7c0-d38e120f6c42 req-a199e737-25ea-4d0a-bbf6-38c5dad51202 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9a827f9-9577-47c5-a741-f032e52bc60d", "tag": "65e7901c-1032-4c03-9499-ab0d2f7a3e68"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:10.099101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-218b2ff5-4c45-4809-b7c0-d38e120f6c42 req-a199e737-25ea-4d0a-bbf6-38c5dad51202 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:10.099749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-218b2ff5-4c45-4809-b7c0-d38e120f6c42 req-a199e737-25ea-4d0a-bbf6-38c5dad51202 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:10.139105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-218b2ff5-4c45-4809-b7c0-d38e120f6c42 req-a199e737-25ea-4d0a-bbf6-38c5dad51202 service nova] Creating event network-changed:65e7901c-1032-4c03-9499-ab0d2f7a3e68 for instance b9a827f9-9577-47c5-a741-f032e52bc60d on hv-cinder-83482 Jul 29 06:28:10.145577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-218b2ff5-4c45-4809-b7c0-d38e120f6c42 req-a199e737-25ea-4d0a-bbf6-38c5dad51202 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061702 Jul 29 06:28:10.147598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 114/238] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:10.683102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:10.683720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:10.690384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:10.691030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:10.691797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:10.692238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:10.821899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:10.831043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d715f050-9eae-4bff-8c25-57fc2904db2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.151669 Jul 29 06:28:10.831626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 125/239] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:10 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:10.862223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:10.862922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:10.869171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:10.869623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:10.870390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:10.870826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:10.973523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1474549486", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:11.025846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] validate_networks() for None {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:28:11.054836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:11.063071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3e7b0ebb-58ac-4be3-a693-a29cab6f98e0 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1313 microversion: 2.1 time: 0.205688 Jul 29 06:28:11.063737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 115/240] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:10 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:11.323948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:28:11.324374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:28:11.324880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:28:11.325324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:28:11.325770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:28:11.336167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:11.336711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:11.337527 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:11.337962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:11.354987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Getting quotas for project 77d0443b289548b1b6e96bb268977c69. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:28:11.359465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Getting quotas for user e8d0f88d70ba4646a10c89d9d32de574 and project 77d0443b289548b1b6e96bb268977c69. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:28:11.370681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:28:11.373651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:28:11.418330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5bb19eb4-2269-46bc-8828-4dacdfd6bad8 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.448455 Jul 29 06:28:11.418892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 126/241] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:28:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 450 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 06:28:11.429751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-25fb37f7-c7a6-4e68-8494-4018cf998d16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:11.430368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-25fb37f7-c7a6-4e68-8494-4018cf998d16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:11.490142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-25fb37f7-c7a6-4e68-8494-4018cf998d16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:11.498597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-25fb37f7-c7a6-4e68-8494-4018cf998d16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1215 microversion: 2.1 time: 0.072040 Jul 29 06:28:11.512073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 116/242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:11 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:11.854468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:11.855244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:11.870367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:11.870852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:11.885202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:11.885725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:12.046557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:12.056294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6b0607fd-f65a-469e-ab63-b90b3b4f2b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.206901 Jul 29 06:28:12.056910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 127/243] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:11 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:12.087163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:12.088513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:12.098248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:12.099068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:12.100354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:12.101014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:12.255365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:12.266786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e44a885e-97bb-4c7b-a8f0-9c70c997c8db tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1313 microversion: 2.1 time: 0.185577 Jul 29 06:28:12.267383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 117/244] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:12 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:12.534350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:12.535100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:12.543548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:12.544143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:12.545632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:12.546517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:12.625283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:12.632940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-de971236-9d88-4d2d-ab77-4fbb60fe7ba7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1267 microversion: 2.1 time: 0.102515 Jul 29 06:28:12.633504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 128/245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:12 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:13.077827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:13.078452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:13.085856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.086308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.087258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.087740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.234908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:13.242671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5e4de80d-5543-4a94-8fd4-837bf6323008 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.169420 Jul 29 06:28:13.246472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 118/246] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:13 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:13.287391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:13.290828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:13.318015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.318475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.320378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.321612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.501374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:13.514858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-660d6910-e357-49d7-a5c0-ee3e00032bb7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1313 microversion: 2.1 time: 0.231390 Jul 29 06:28:13.515824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 129/247] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:13 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:13.657677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:13.658511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:13.670213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.670900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.674717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.675229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.906260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:13.908094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-c38590c0-f172-443d-a62c-2c2a89d26e90 req-a5fb27f8-ccb9-4f91-ac07-72823b30e142 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a827f9-9577-47c5-a741-f032e52bc60d", "name": "network-vif-plugged", "status": "completed", "tag": "65e7901c-1032-4c03-9499-ab0d2f7a3e68"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:13.914058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2e0bda2c-e036-4551-9795-75f736ceaa81 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1267 microversion: 2.1 time: 0.262491 Jul 29 06:28:13.914640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 119/248] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:13 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:13.928518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-c38590c0-f172-443d-a62c-2c2a89d26e90 req-a5fb27f8-ccb9-4f91-ac07-72823b30e142 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:13.928518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-c38590c0-f172-443d-a62c-2c2a89d26e90 req-a5fb27f8-ccb9-4f91-ac07-72823b30e142 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:13.940513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-c38590c0-f172-443d-a62c-2c2a89d26e90 req-a5fb27f8-ccb9-4f91-ac07-72823b30e142 service nova] Creating event network-vif-plugged:65e7901c-1032-4c03-9499-ab0d2f7a3e68 for instance b9a827f9-9577-47c5-a741-f032e52bc60d on hv-cinder-83482 Jul 29 06:28:13.949838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-c38590c0-f172-443d-a62c-2c2a89d26e90 req-a5fb27f8-ccb9-4f91-ac07-72823b30e142 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052963 Jul 29 06:28:13.950450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 130/249] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:14.267930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:14.269171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:14.277882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:14.278624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:14.280223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:14.280695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:14.456277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:14.464753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-371df423-b248-40bd-991f-bc98c9f47593 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.201424 Jul 29 06:28:14.465328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 120/250] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:14 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:14.536031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:14.536843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:14.543105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:14.543568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:14.544311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:14.544824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:14.740193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:14.749042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-55f1bd80-5862-443b-8790-9266b0919155 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1313 microversion: 2.1 time: 0.217156 Jul 29 06:28:14.749849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 131/251] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:14 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:14.931688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1460142291", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "networks": [{"uuid": "9fb54aae-ec14-47a4-acd6-caf395f03637"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:14.934434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:14.935045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:14.942251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:14.942703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:14.943470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:14.943903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.001021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] validate_networks() for [('9fb54aae-ec14-47a4-acd6-caf395f03637', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:28:15.191540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:15.200074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f15d678-31b7-4ef5-99cb-93d03ab2a664 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.269269 Jul 29 06:28:15.200998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 132/252] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:14 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:15.428891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:28:15.429335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:28:15.429814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:28:15.430255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:28:15.430705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:28:15.439767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:15.440219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.441054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:15.441498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.459200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Getting quotas for project 002000e5606c46c29c87b0fa2fe68b3c. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:28:15.463259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Getting quotas for user 5e05c9bdfc114478b5d80f077b970d17 and project 002000e5606c46c29c87b0fa2fe68b3c. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:28:15.475559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:28:15.477871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:28:15.487602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:15.488378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:15.497229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:15.497570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.499250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:15.500042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.531049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d2de981-f320-4148-a124-da1219600e58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603810 Jul 29 06:28:15.532507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 121/253] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:28:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:28:15.546105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-818aae40-80d2-4782-a0ce-c7af7c872e51 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:15.547511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-818aae40-80d2-4782-a0ce-c7af7c872e51 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:15.627025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-818aae40-80d2-4782-a0ce-c7af7c872e51 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:15.637680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-818aae40-80d2-4782-a0ce-c7af7c872e51 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1219 microversion: 2.1 time: 0.098738 Jul 29 06:28:15.638524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 122/254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:15 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:15.673255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:15.686808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1427dff6-2408-4dd6-aad4-d9c1f14666eb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1522 microversion: 2.1 time: 0.202996 Jul 29 06:28:15.688109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 133/255] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:15 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:15.770005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:15.771094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:15.777430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:15.778042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.778837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:15.780074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:15.798984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:15.935817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:15.943334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c45d5ea-aebb-47df-b725-910b7dde0e67 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1313 microversion: 2.1 time: 0.177017 Jul 29 06:28:15.943912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 123/256] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:15 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:16.227141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:16.228660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:16.240002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.240896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.242202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.242884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.467319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:16.475718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2088fee8-09c3-4fcc-9369-5202aa2e222b tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.255637 Jul 29 06:28:16.476507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 134/257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:16 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:16.659971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:16.660612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:16.667851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.668297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.673074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.673545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.709534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:16.710784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:16.722524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.724822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.726510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.729465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.737225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:16.806386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:16.817791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-988dea70-42f2-4014-9626-c56f37fcd781 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1271 microversion: 2.1 time: 0.161587 Jul 29 06:28:16.818625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 124/258] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:16 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:16.823525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-a4f995a4-9f7b-470b-8ae3-1368e2809e0d req-52a272be-cb1a-4214-8915-12d86b3258f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd", "tag": "3a6d700e-5f59-4ced-81a9-f2e4ffff31e8"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:16.839907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a4f995a4-9f7b-470b-8ae3-1368e2809e0d req-52a272be-cb1a-4214-8915-12d86b3258f1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:16.840632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a4f995a4-9f7b-470b-8ae3-1368e2809e0d req-52a272be-cb1a-4214-8915-12d86b3258f1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:16.991681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:17.002484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-76f2b320-15f6-4731-920a-4d7f797ae772 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1502 microversion: 2.1 time: 0.297554 Jul 29 06:28:17.003603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 135/259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:16 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1502 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:17.012403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:17.013444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:17.021413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.022333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.023192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.023709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.040455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-a4f995a4-9f7b-470b-8ae3-1368e2809e0d req-52a272be-cb1a-4214-8915-12d86b3258f1 service nova] Creating event network-changed:3a6d700e-5f59-4ced-81a9-f2e4ffff31e8 for instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd on hv-cinder-83482 Jul 29 06:28:17.046162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-a4f995a4-9f7b-470b-8ae3-1368e2809e0d req-52a272be-cb1a-4214-8915-12d86b3258f1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.225760 Jul 29 06:28:17.047219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 125/260] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:17.052889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:17.053672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:17.060192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.061349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.062205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.062715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.173654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:17.193896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c2a1796-87c0-429d-902e-bafd88a749c1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1497 microversion: 2.1 time: 0.187298 Jul 29 06:28:17.194777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 136/261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:17 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:17.351868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:17.365700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5e330ad5-03cf-4166-85d4-331e5f8a4de8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1515 microversion: 2.1 time: 0.317221 Jul 29 06:28:17.366268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 126/262] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:17 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1515 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:17.499757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:17.500724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:17.514157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.515122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.516135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.517770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.839409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:17.840066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:17.840422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:17.849632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.857799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.858096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c9d05674-1fa2-482c-b28e-368ab03e89ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.357927 Jul 29 06:28:17.858899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 137/263] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:17 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:17.863161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:17.863819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:17.951879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:17.962857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c87e9781-9ef8-497a-8418-15ec3d5acf7b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1277 microversion: 2.1 time: 0.127233 Jul 29 06:28:17.981277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 127/264] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:17 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:18.377524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:18.378017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:18.383941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.384387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.385174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.385609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.410457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:28:18.485090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f6342486-239f-4ce6-952e-a27175ea8ad2 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "DELETE /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 204 len: 0 microversion: 2.1 time: 0.111751 Jul 29 06:28:18.485663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 138/265] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:28:18 2022] DELETE /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:28:18.493751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:18.494390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:18.504061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.504687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.505857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.506292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.637877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:18.646087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6413292e-33cf-4d2b-b605-f1d6968d0ddd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1503 microversion: 2.1 time: 0.156202 Jul 29 06:28:18.646648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 128/266] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:18 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:18.881472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:18.882075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:18.888000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.889201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.889989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.890431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.989120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:18.990327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:18.997041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.997485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:18.998667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:18.999080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.039530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:19.047846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5b6c85a3-dfaf-46f7-aa7f-85430450810e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.170621 Jul 29 06:28:19.049372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 139/267] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:18 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:19.065529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:19.068985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:19.079991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.080239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.081184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.081852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.105541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lazy-loading 'flavor' on Instance uuid f5dc91c9-6f94-4b19-a397-19669b267c43 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:28:19.208111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-36b6d3e6-3130-4a9a-98b6-73aa906f02d5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/action" status: 200 len: 32 microversion: 2.1 time: 0.155283 Jul 29 06:28:19.209866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 140/268] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:28:19 2022] POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/action => generated 32 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 06:28:19.216033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:19.217418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:19.223988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.224495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.225492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.225994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.253413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7658d300-fee7-4c04-8a86-96ce87d676c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/ips" status: 200 len: 146 microversion: 2.1 time: 0.042007 Jul 29 06:28:19.254115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 141/269] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:28:19 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:19.260761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:19.261515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:19.268420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.269204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.270350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.271062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.278351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:19.291543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9f63a55f-663a-4e80-b012-9828e66bb1d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.305800 Jul 29 06:28:19.294029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 129/270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:18 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:19.423498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:19.433996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1dc6236e-aae4-4631-98fc-b1b83be1c149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.178437 Jul 29 06:28:19.434852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 142/271] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:19 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:19.566792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-4f03949f-1e21-4e82-bbf9-71ccf4437628 req-3faa08f4-0cfe-40db-898e-001d3d4da766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4244f0f-2067-4323-b059-2b96798f8337", "tag": "4a07cbcd-5d41-419d-a8bd-9dd0a79c3d41"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:19.571759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:19.577795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4f03949f-1e21-4e82-bbf9-71ccf4437628 req-3faa08f4-0cfe-40db-898e-001d3d4da766 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.578243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-4f03949f-1e21-4e82-bbf9-71ccf4437628 req-3faa08f4-0cfe-40db-898e-001d3d4da766 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.595260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-4f03949f-1e21-4e82-bbf9-71ccf4437628 req-3faa08f4-0cfe-40db-898e-001d3d4da766 service nova] Creating event network-changed:4a07cbcd-5d41-419d-a8bd-9dd0a79c3d41 for instance a4244f0f-2067-4323-b059-2b96798f8337 on hv-cinder-83482 Jul 29 06:28:19.600748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-4f03949f-1e21-4e82-bbf9-71ccf4437628 req-3faa08f4-0cfe-40db-898e-001d3d4da766 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037607 Jul 29 06:28:19.601344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 130/272] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:19.667211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:19.667826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:19.674712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.675099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.675871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:19.676311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:19.813151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:19.820856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22e4cd47-50c1-4f1f-badf-270a09c868dd tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1503 microversion: 2.1 time: 0.157449 Jul 29 06:28:19.821457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 143/273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:19 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:20.070745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:20.071509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:20.079165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:20.079617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:20.080394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:20.080936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:20.283718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:20.293986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7f813be9-6ad6-464f-89de-9339119b64c0 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.227936 Jul 29 06:28:20.295437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 131/274] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:20 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:20.315323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:20.316620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:20.326992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:20.327473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:20.328297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:20.333828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:20.462548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:20.463321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:20.475424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:20.476264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:20.477299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:20.477951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:20.988992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:21.002558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-55d0f368-8183-4bfc-9d9e-765429f31a0c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.547206 Jul 29 06:28:21.004955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 132/275] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:20 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:21.012927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:21.015013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:21.024819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.025552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.026985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.028458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.038432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:21.051261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5de3640b-8558-4717-8bdb-e0f18716c09a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.735521 Jul 29 06:28:21.052047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 144/276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:20 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:21.058970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:21.066268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:21.066559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-07dd6faa-03cf-46e0-9051-28a8fb2d9f17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/ips" status: 200 len: 152 microversion: 2.20 time: 0.059053 Jul 29 06:28:21.067321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 133/277] 10.222.0.33 () {60 vars in 1289 bytes} [Fri Jul 29 06:28:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:28:21.090911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.092746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.094314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.098773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.318915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:21.320915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:21.331001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.332024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.334013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.334957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.346641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:21.367485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=8 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:21.582164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:21.590617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fd1a25ce-402e-406f-a126-86c4f7b67aec tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.278156 Jul 29 06:28:21.597457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 134/278] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:21 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:21.615035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:21.625102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b21bb6f9-a878-45b0-accc-be65e3593ca1 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1503 microversion: 2.1 time: 0.570106 Jul 29 06:28:21.625928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 145/279] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:21 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1503 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:21.838609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-e5122c9e-e8ee-4e1b-b7f3-cd0e1c59c2bd req-7dc4c2f5-896a-484d-888e-a8396c134bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd", "name": "network-vif-plugged", "status": "completed", "tag": "3a6d700e-5f59-4ced-81a9-f2e4ffff31e8"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:21.856789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e5122c9e-e8ee-4e1b-b7f3-cd0e1c59c2bd req-7dc4c2f5-896a-484d-888e-a8396c134bc7 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.857511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e5122c9e-e8ee-4e1b-b7f3-cd0e1c59c2bd req-7dc4c2f5-896a-484d-888e-a8396c134bc7 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.880382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-e5122c9e-e8ee-4e1b-b7f3-cd0e1c59c2bd req-7dc4c2f5-896a-484d-888e-a8396c134bc7 service nova] Creating event network-vif-plugged:3a6d700e-5f59-4ced-81a9-f2e4ffff31e8 for instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd on hv-cinder-83482 Jul 29 06:28:21.907723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-e5122c9e-e8ee-4e1b-b7f3-cd0e1c59c2bd req-7dc4c2f5-896a-484d-888e-a8396c134bc7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088718 Jul 29 06:28:21.908621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 135/280] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:21.909805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-3818553b-931a-4d06-8fc6-1dc1eee137d4 req-a4ffbc7b-90c1-44f7-91cc-27dd6c546d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9a827f9-9577-47c5-a741-f032e52bc60d", "name": "network-vif-deleted", "tag": "65e7901c-1032-4c03-9499-ab0d2f7a3e68"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:21.920058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3818553b-931a-4d06-8fc6-1dc1eee137d4 req-a4ffbc7b-90c1-44f7-91cc-27dd6c546d16 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:21.920514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3818553b-931a-4d06-8fc6-1dc1eee137d4 req-a4ffbc7b-90c1-44f7-91cc-27dd6c546d16 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:21.933289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-3818553b-931a-4d06-8fc6-1dc1eee137d4 req-a4ffbc7b-90c1-44f7-91cc-27dd6c546d16 service nova] Creating event network-vif-deleted:65e7901c-1032-4c03-9499-ab0d2f7a3e68 for instance b9a827f9-9577-47c5-a741-f032e52bc60d on hv-cinder-83482 Jul 29 06:28:21.938590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-3818553b-931a-4d06-8fc6-1dc1eee137d4 req-a4ffbc7b-90c1-44f7-91cc-27dd6c546d16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033673 Jul 29 06:28:21.939394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 146/281] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:22.027170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:22.028107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:22.035169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.035828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.036711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.037052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.077058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:22.077992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:22.085393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.086014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.086780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.087260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.193682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:22.202539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-65df0eae-1791-40b2-9d91-b71cf06cd5a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.179447 Jul 29 06:28:22.203770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 136/282] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:22 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:22.244137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:22.255078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5967da08-0411-4063-9cf6-e9480221b366 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.183077 Jul 29 06:28:22.255994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 147/283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:22 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:22.612754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:22.613983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:22.620242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.620849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.621524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.622028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.651253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:22.653314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:22.662525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.662967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.664074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:22.664776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:22.781382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bb264bd9834f5fa61b58362ec48d31', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c241dc0f043e46c8a01503a1c343abf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:22.797152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8c98915-cb4f-48fe-87e7-532a6b8b5ad7 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 200 len: 1298 microversion: 2.1 time: 0.150445 Jul 29 06:28:22.797438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 148/284] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:22 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:22.822883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:22.831221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2dcdd397-e348-4378-b5ea-6076b8ea46ab tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.222758 Jul 29 06:28:22.831794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 137/285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:22 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:23.224895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:23.225496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:23.231915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.232979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.233985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.234414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.257950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:23.290377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:23.291007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:23.298104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.298549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.299517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.300015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.434232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:23.443477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:23.444779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a143fa88-1cc7-498d-bb4e-a39badfd4789 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.223714 Jul 29 06:28:23.445349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 149/286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:23 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:23.453204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06b2dc46-dc8d-4e57-8bbc-724c542a925c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.171409 Jul 29 06:28:23.456320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cfc7f11-2b7a-49d0-8d6c-c9235e799c0b"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:23.459186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:23.463189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 138/287] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:23 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:23.465830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.466881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.467811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.468239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.787764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cc1dce40-5907-4113-9af9-ad7aa3924c2b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.340771 Jul 29 06:28:23.788380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 150/288] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 06:28:23 2022] POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-volume_attachments => generated 194 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:23.819614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:23.820170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] [instance: b9a827f9-9577-47c5-a741-f032e52bc60d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:23.826344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.827603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.828519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.829134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.844646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] HTTP exception thrown: Instance b9a827f9-9577-47c5-a741-f032e52bc60d could not be found. Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Request method failure captured: Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d HTTP/1.1 Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi433eK8DNds89jc3WlusH7ByLf0G2UmIoBJmMrT0Kyi1TKERvfgDvwqCFQ7E3EBqmeaB1ygdw2gkeQBn5sz-VtJcNrKuNnnYsKFtUmMD7w0OwhLETpcRFC082VbWE6kp7j9Kb1_6c6y4fzK77tL27MWOh6_hMOjKry_X_dN2YsqDkxIQ Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: c241dc0f043e46c8a01503a1c343abf9 Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesActionsTest-177501211 Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:28:23.847071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c241dc0f043e46c8a01503a1c343abf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c241dc0f043e46c8a01503a1c343abf9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c241dc0f043e46c8a01503a1c343abf9", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c241dc0f043e46c8a01503a1c343abf9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesActionsTest-177501211 Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: c241dc0f043e46c8a01503a1c343abf9 Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesActionsTest-177501211 Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesActionsTest-177501211-project Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 55bb264bd9834f5fa61b58362ec48d31 Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesActionsTest-177501211-project Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance b9a827f9-9577-47c5-a741-f032e52bc60d could not be found. Jul 29 06:28:23.848599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'b9a827f9-9577-47c5-a741-f032e52bc60d'} Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9a827f9-9577-47c5-a741-f032e52bc60d could not be found. Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:28:23.849425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9a827f9-9577-47c5-a741-f032e52bc60d could not be found. Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9a827f9-9577-47c5-a741-f032e52bc60d could not be found. Jul 29 06:28:23.850779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:23.858587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:23.859909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:23.864917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] Returning 404 to user: Instance b9a827f9-9577-47c5-a741-f032e52bc60d could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:28:23.868656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-54107340-5924-4095-ae52-8db1d6a79fe4 tempest-VolumesActionsTest-177501211 tempest-VolumesActionsTest-177501211-project] 10.222.0.33 "GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d" status: 404 len: 111 microversion: 2.1 time: 0.050810 Jul 29 06:28:23.869390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 139/289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:23 2022] GET /compute/v2.1/servers/b9a827f9-9577-47c5-a741-f032e52bc60d => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:28:23.890351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.891253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:23.892473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:23.892875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.091569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:24.099091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aa479215-351c-4c5a-8fc8-9c5548ba5092 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.245772 Jul 29 06:28:24.099652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 151/290] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:23 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:24.198860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:24.199481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:24.206100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.206561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.207335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.208047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.235022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lazy-loading 'flavor' on Instance uuid 6e189d03-298a-49f1-8edc-ee412247810f {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:28:24.358015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:24.468730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:24.469674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:24.476978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.477501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.478439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.479037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.539102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-de70130f-f20e-4f84-b0bb-e673b77de069 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/action" status: 202 len: 0 microversion: 2.20 time: 0.343963 Jul 29 06:28:24.539696 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 140/291] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Jul 29 06:28:24 2022] POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:28:24.546024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:24.547296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:24.555114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.555570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.556350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.556828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.646767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:24.655839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c8e7b39f-7257-4c94-8eb2-31126d5b647b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.191841 Jul 29 06:28:24.670282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 152/292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:24 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:24.675299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:24.675917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:24.682132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.682667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.683496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:24.683935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:24.709353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:24.725789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a58fc7c-1e4f-4572-ab5e-4ff29d62b599 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.184709 Jul 29 06:28:24.736680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 141/293] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:24 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:24.826678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:24.834732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:24.836220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:24.837388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a2976a1e-2b90-40b9-8ad5-d7d880ae4af6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.165918 Jul 29 06:28:24.837962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 153/294] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:25.120217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:25.120908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:25.128379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.129100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.129879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.130333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.266865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:25.274326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9c632f24-7c76-4194-8e5a-b97b751b899e tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.158458 Jul 29 06:28:25.274889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 142/295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:25 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:25.677795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:25.678405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:25.684980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.685973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.686738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.687177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.747344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:25.748116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:25.750784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:25.751474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=16 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:25.757642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.758086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.758870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.759304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.897293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:25.904690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b21c451c-4788-4856-b029-738da69fde41 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.161364 Jul 29 06:28:25.905254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 143/296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:25 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:25.909646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:25.910236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:25.916371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.917041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.917800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:25.918395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:25.966806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:25.974917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a9b17f85-ec35-4af0-b3d3-4afae85135b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.300897 Jul 29 06:28:25.975564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 154/297] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:25 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:26.050787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:26.058623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:26.060583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:26.061756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-444534a6-7380-42c6-a041-16da019c1ba9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.155590 Jul 29 06:28:26.062326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 144/298] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:26.295310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:26.295924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:26.301926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:26.302372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:26.303125 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:26.303560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:26.431663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:26.439570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a7e4f09e-f811-4561-804f-4676aca7277f tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.148165 Jul 29 06:28:26.440160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 155/299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:26 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:26.926233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:26.926836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:26.933272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:26.933720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:26.934476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:26.935573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:26.996763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:26.997864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:27.000196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:27.006521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.007042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.007843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.008281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.065619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:27.074417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-98e1c80e-37f1-4cd8-91cd-67d73c2371ae tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.152046 Jul 29 06:28:27.074990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 145/300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:26 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:27.085889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:27.086583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:27.092929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.093388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.094165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.094609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.143340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:27.150719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b27d199c-4a92-4f3f-82d2-879cf9234277 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.157938 Jul 29 06:28:27.151573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 156/301] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:26 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:27.228873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:27.237323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:27.238840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:27.239996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e6796aa2-948f-498d-b18b-beaf240d59ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.158575 Jul 29 06:28:27.240559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 146/302] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:27.460625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:27.461404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:27.468182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.468752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.469721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.470148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.618379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:27.626310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e173b253-99e0-4bc5-a95f-9eced145ca87 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1315 microversion: 2.1 time: 0.169803 Jul 29 06:28:27.626888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 157/303] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:27 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:27.932778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-d7870d25-14e1-441a-a864-10365944ad04 req-5d941d6b-1ad4-42c2-a6bf-96e31f0e79d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4244f0f-2067-4323-b059-2b96798f8337", "name": "network-vif-plugged", "status": "completed", "tag": "4a07cbcd-5d41-419d-a8bd-9dd0a79c3d41"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:27.943389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d7870d25-14e1-441a-a864-10365944ad04 req-5d941d6b-1ad4-42c2-a6bf-96e31f0e79d1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:27.943907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d7870d25-14e1-441a-a864-10365944ad04 req-5d941d6b-1ad4-42c2-a6bf-96e31f0e79d1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:27.955262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-d7870d25-14e1-441a-a864-10365944ad04 req-5d941d6b-1ad4-42c2-a6bf-96e31f0e79d1 service nova] Creating event network-vif-plugged:4a07cbcd-5d41-419d-a8bd-9dd0a79c3d41 for instance a4244f0f-2067-4323-b059-2b96798f8337 on hv-cinder-83482 Jul 29 06:28:27.960239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-d7870d25-14e1-441a-a864-10365944ad04 req-5d941d6b-1ad4-42c2-a6bf-96e31f0e79d1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031137 Jul 29 06:28:27.961034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 147/304] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:28.096393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:28.097174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:28.103808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.104338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.105213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.105733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.174388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:28.175187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:28.181550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.182079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.183213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.183310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.236434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:28.244098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e5ac5650-bd1a-4bbb-b8fe-16872d3057d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.151547 Jul 29 06:28:28.244673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 158/305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:28 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:28.263499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:28.264107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:28.271159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.271610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.272371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.272840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.316673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:28.324283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b3840c5f-62f5-48df-a507-9784c3e0a8a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.154987 Jul 29 06:28:28.324905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 148/306] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:28 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:28.409298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:28.417204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:28.418764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:28.420073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a0c25d16-55a6-4aef-b1df-28ccbbd08682 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.160939 Jul 29 06:28:28.420662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 159/307] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:28.647462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:28.647990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:28.655247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.655692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.656457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.656918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.787917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:28.796591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eb05c9b5-bd31-4e4f-8f36-4b8eed12df16 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1464 microversion: 2.1 time: 0.153071 Jul 29 06:28:28.797156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 149/308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:28 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:28.844189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:28.844747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:28.851383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.851840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.852634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.853079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.878657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:28:28.957602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eb14c5b2-8394-47c0-80a2-5d3e4d5e7e2d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 204 len: 0 microversion: 2.1 time: 0.117367 Jul 29 06:28:28.958375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 160/309] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:28:28 2022] DELETE /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:28:28.966744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:28.967358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:28.973729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.974173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:28.974926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:28.975356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.103173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:29.111075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-41925448-18d4-422d-a0c0-0db56aed4da6 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.148358 Jul 29 06:28:29.111634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 150/310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:28 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:29.267194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:29.267811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:29.274263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:29.274710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.275458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:29.275922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.346645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:29.347263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:29.353795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:29.353795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.354552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:29.354999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.406257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:29.413802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2e4d92a8-d961-4e52-9c53-f9329e285520 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.151461 Jul 29 06:28:29.414374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 161/311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:29 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:29.443514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:29.444233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:29.450448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:29.450998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.451839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:29.452345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:29.485715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:29.493450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2baf5d6c-7561-40c9-87a5-a70dc7390d6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.150554 Jul 29 06:28:29.494032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 151/312] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:29 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:29.585557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:29.587893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:29.595767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:29.597321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:29.598491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-028b8902-be68-431c-93b9-163a202200b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.159228 Jul 29 06:28:29.599055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 162/313] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:30.132633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:30.133161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:30.139774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.140219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.141007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.141444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.274063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:30.281504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-148c2160-5cd7-4e39-87bd-7b7d1b19aaf2 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.152849 Jul 29 06:28:30.282053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 152/314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:30 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:30.435390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:30.436302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:30.443775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.444220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.444998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.445439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.515354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:30.515973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:30.521992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.522449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.523224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.523988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.575816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:30.583875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bb777af2-ac52-4fab-ac9a-65d6c92d929c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.153554 Jul 29 06:28:30.584756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 163/315] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:30 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:30.621433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:30.622047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:30.628094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.628568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.629384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:30.629827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:30.653403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:30.661555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6da369e6-8f58-4ece-8544-a31888d35b6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.150636 Jul 29 06:28:30.662131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 153/316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:30 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:30.760298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:30.768321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:30.769875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:30.771037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4aa6955f-cae7-4983-aa34-dbcff7b3e8c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.153502 Jul 29 06:28:30.771588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 164/317] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:31.302151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:31.302769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:31.309239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.309751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.310778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.311221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.445433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:31.453616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-42319603-60ac-4d00-b76c-35883675b201 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.155294 Jul 29 06:28:31.454278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 154/318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:31 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:31.605334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:31.606011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:31.612738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.613191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.613961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.614404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.683760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:31.684393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:31.690472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.690918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.691680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.692114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.751634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:31.759103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-74a3b564-16bb-45b2-b3ae-65591b0d4aef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.157578 Jul 29 06:28:31.759740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 165/319] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:31 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:31.795240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:31.796016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:31.801974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.802431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.803197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:31.803634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:31.822799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:31.831218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0bc30fab-2926-48d7-a703-11cf9024b8ef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.151833 Jul 29 06:28:31.832416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 155/320] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:31 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:31.933908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:31.941866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:31.943366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:31.944510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d656be95-2c88-48fe-b315-c30db059b044 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.153960 Jul 29 06:28:31.945083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 166/321] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:32.475168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:32.475782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:32.482614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.483069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.483835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.484273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.620742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:32.629308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e3b225dc-d13a-4661-895b-d466309c9196 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.157944 Jul 29 06:28:32.629864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 156/322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:32 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:32.780998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:32.781611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:32.788099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.788568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.789326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.789758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.853372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:32.853987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:32.860025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.860479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.861276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.861722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.927740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:32.937061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b765205f-f74c-49ee-a6db-02bbcbd55834 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.160609 Jul 29 06:28:32.937640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 167/323] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:32 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:32.968263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:32.968984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:32.974976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.975431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.976195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:32.976666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:32.991063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:32.999201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-93061866-0dd0-4b98-98c8-6f568ee13440 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.149695 Jul 29 06:28:32.999763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 157/324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:32 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:33.103339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:33.111940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:33.113439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:33.114603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-69a8f9a0-321c-448e-b6d1-d9bed9191346 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.150861 Jul 29 06:28:33.115153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 168/325] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:33.650761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:33.651404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:33.658027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:33.658479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:33.659249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:33.659692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:33.663801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:33.786502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:33.795176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4e2005f4-13a3-44de-a5b6-efd63f9e744d tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.147517 Jul 29 06:28:33.795945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 158/326] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:33 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:33.957575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:33.958444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:33.964923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:33.965374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:33.966842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:33.967278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:34.020916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:34.021560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:34.027752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:34.028088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:34.029746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:34.030353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:34.097215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:34.104559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e743a788-c6ee-4f18-a7ce-56120e257956 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.150725 Jul 29 06:28:34.105119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 169/327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:33 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:34.136529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:34.137164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:34.143863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:34.144320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:34.145117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:34.145554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:34.165078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:34.173413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ac004f5-fcc9-47ee-9295-6a36e617678f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.156291 Jul 29 06:28:34.173971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 159/328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:34 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:34.284979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:34.293069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:34.295130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:34.296268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe665aa5-661f-4101-a035-631b3256e650 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.163589 Jul 29 06:28:34.296849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 170/329] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:34.819281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:34.819891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:34.827181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:34.827633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:34.828398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:34.828877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.021765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:35.033596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-febc0978-d0e4-4c4f-b6a8-83252b98b4d7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.218185 Jul 29 06:28:35.034816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 160/330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:34 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:35.128529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:35.130099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:35.140852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:35.141848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.142999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:35.143626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.202440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:35.203621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:35.223021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:35.224142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.225164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:35.225759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.395537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:35.405636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af310b7c-3976-42cf-86e3-be8d7108ae9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.214402 Jul 29 06:28:35.406959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 161/331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:35 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:35.412954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:35.413861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:35.422092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:35.424788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.425841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:35.426483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:35.434681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:35.443545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5fa866eb-8229-414a-9a52-6cc7bef5c1d5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.319623 Jul 29 06:28:35.444652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 171/332] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:35 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:35.604581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:35.612988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:35.614497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:35.615680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82e7a93a-0541-4b24-a6fb-a3343183b13e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.207310 Jul 29 06:28:35.632628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 162/333] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:36.056608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:36.057325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:36.069013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.069759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.070674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.071676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.234612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:36.245291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1c60835e-6946-4ff1-b0ff-e71729c8b418 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1470 microversion: 2.1 time: 0.193261 Jul 29 06:28:36.246529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 172/334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:36 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:36.439120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:36.440462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:36.448400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.448964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.450145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.450938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.467664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:36.468942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:36.476918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.478400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.479547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.481248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.615660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:36.627841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-61f9781f-207e-479f-8be0-bdb52a214571 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.193896 Jul 29 06:28:36.628498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 163/335] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:36 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:36.646581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:36.647431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:36.659901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.660474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.661438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:36.661953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:36.786995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:36.797394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-63c3588b-276e-4acb-b298-bd10d7dd55d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1319 microversion: 2.1 time: 0.334029 Jul 29 06:28:36.798326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 173/336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:36 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:36.848947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:36.860488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:36.862343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:36.864029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9a05d5ff-2d20-4b68-a2c8-83ce0a9b3fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.222118 Jul 29 06:28:36.865129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 164/337] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:37.267626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:37.268313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:37.282956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-0d17fff9-167b-4160-abcb-d46bdd0a540c req-2e60bbfb-d668-4bab-a823-b3e02e8ab78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd", "name": "network-vif-deleted", "tag": "3a6d700e-5f59-4ced-81a9-f2e4ffff31e8"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:37.298495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.300310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.301945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.302532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.309523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0d17fff9-167b-4160-abcb-d46bdd0a540c req-2e60bbfb-d668-4bab-a823-b3e02e8ab78f service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.310231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0d17fff9-167b-4160-abcb-d46bdd0a540c req-2e60bbfb-d668-4bab-a823-b3e02e8ab78f service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.340681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-0d17fff9-167b-4160-abcb-d46bdd0a540c req-2e60bbfb-d668-4bab-a823-b3e02e8ab78f service nova] Creating event network-vif-deleted:3a6d700e-5f59-4ced-81a9-f2e4ffff31e8 for instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd on hv-cinder-83482 Jul 29 06:28:37.359625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-0d17fff9-167b-4160-abcb-d46bdd0a540c req-2e60bbfb-d668-4bab-a823-b3e02e8ab78f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080052 Jul 29 06:28:37.360079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 165/338] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:37.419313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:37.447069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-108fe8c5-9a7e-44ec-8050-088e2103b4ae tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1428 microversion: 2.1 time: 0.182049 Jul 29 06:28:37.452164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 174/339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:37 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1428 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:37.651786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:37.653355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:37.660530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.661315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.662337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.662849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.806827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f90826f2-62c0-4312-be98-9bbf22c9b141 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:37.831084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:37.835742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f90826f2-62c0-4312-be98-9bbf22c9b141 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.839011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f90826f2-62c0-4312-be98-9bbf22c9b141 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.843245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-862b0aee-65ac-42be-a930-a7c6b700ec27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.195546 Jul 29 06:28:37.844146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 166/340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:37 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:37.849209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:37.850134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:37.857778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.858607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.859741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.860421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:37.924483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f90826f2-62c0-4312-be98-9bbf22c9b141 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Going to try to stop instance {{(pid=117957) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 06:28:37.978738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f90826f2-62c0-4312-be98-9bbf22c9b141 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action" status: 202 len: 0 microversion: 2.1 time: 0.176721 Jul 29 06:28:37.980059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 175/341] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:28:37 2022] POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:28:37.988496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:37.989483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:37.999041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:37.999911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.001039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.001751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.014869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:38.025336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7c760d2b-a88f-4489-b667-7d2714c25ea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1508 microversion: 2.1 time: 0.179797 Jul 29 06:28:38.027074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 167/342] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:37 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:38.033907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:38.034931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:38.042445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.042949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.043773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.044273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.190785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:38.201560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7c896eac-e38d-47b3-ab3e-d3994edc00bd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.172931 Jul 29 06:28:38.202183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 168/343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:38 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:38.244622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:38.260810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:38.263790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:38.265517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8f78ec34-0643-4d4f-8cfa-094257df1d44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.283949 Jul 29 06:28:38.280713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 176/344] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:38.488997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:38.488997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:38.498042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.498042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.498042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.498042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.592097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8d0f88d70ba4646a10c89d9d32de574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77d0443b289548b1b6e96bb268977c69', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:38.605189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-27605bda-4294-4162-8c56-de00717e6ea7 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 200 len: 1300 microversion: 2.1 time: 0.125335 Jul 29 06:28:38.608007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 169/345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:38 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 1300 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:38.874497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:38.875589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:38.891612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.892529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:38.893842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:38.895683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.060282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:39.068782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22b88c83-a7a0-470c-a339-4dd33a27c4a9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.202370 Jul 29 06:28:39.086808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 177/346] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:38 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:39.229248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:39.229981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:39.236379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:39.242448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.245255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:39.248676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.292473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:39.293122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:39.312936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:39.313292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.314091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:39.314525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.378720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:39.524790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:39.539436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:39.547991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:39.550246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-30101375-217a-4200-a367-424ab6da97fb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.326859 Jul 29 06:28:39.551661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:39.565208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 170/347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:39 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:39.565387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-86cdcd2a-56b7-4a32-adfe-21b606e71b8d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.265702 Jul 29 06:28:39.568130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 178/348] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:39.627894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:39.628505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] [instance: ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:39.634892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:39.635615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.636430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:39.636891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:39.651572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] HTTP exception thrown: Instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd could not be found. Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Request method failure captured: Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd HTTP/1.1 Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4335UQ78wWXWzUoQvYBMURcgsU7bl9AG1UbMKFgkclUDvfzgz79pfk--C0swFUIW5xEkD0wSH0nJs-nv9k21VMYj95wM1qPk0FnNkt-5AFqTG77au2UnNo71zqfqL5P4h9pfKxyQdIs3UDJsgamVrmFoE-fezflMbA0zgle5L1CeOsE Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 77d0443b289548b1b6e96bb268977c69 Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesNegativeTest-175436575 Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:28:39.653897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/77d0443b289548b1b6e96bb268977c69"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d0443b289548b1b6e96bb268977c69"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_77d0443b289548b1b6e96bb268977c69", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/77d0443b289548b1b6e96bb268977c69"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesNegativeTest-175436575 Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 77d0443b289548b1b6e96bb268977c69 Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesNegativeTest-175436575 Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesNegativeTest-175436575-project Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: e8d0f88d70ba4646a10c89d9d32de574 Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesNegativeTest-175436575-project Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd could not be found. Jul 29 06:28:39.655346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd'} Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd could not be found. Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:28:39.656188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd could not be found. Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd could not be found. Jul 29 06:28:39.658034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:39.659976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] Returning 404 to user: Instance ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:28:39.659976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3dac7abc-38e9-4701-a41a-5d8a697c4668 tempest-VolumesNegativeTest-175436575 tempest-VolumesNegativeTest-175436575-project] 10.222.0.33 "GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd" status: 404 len: 111 microversion: 2.1 time: 0.031947 Jul 29 06:28:39.659976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 171/349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:39 2022] GET /compute/v2.1/servers/ac65458c-c0ac-4cd0-a9ea-96fc4b174ecd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 06:28:40.096045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:40.096714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:40.103242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:40.103692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:40.104456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:40.105154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:40.247578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:40.255786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-919b6a78-f9d8-41a4-9a45-fc3adf5b399a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.165108 Jul 29 06:28:40.256354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 179/350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:40 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:40.576066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:40.576775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:40.584283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:40.584769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:40.585538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:40.586009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:40.594872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:40.595645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:40.603564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:40.604385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:40.605760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:40.607093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:40.749372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:40.760970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2eaac6d8-775f-42dc-a01e-72176589aac6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.189265 Jul 29 06:28:40.761541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 172/351] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:40 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:40.800087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:40.809136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:40.811721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:40.813152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-955d1f0b-bafd-48c6-91be-16a6d98b01e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.224097 Jul 29 06:28:40.829068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 180/352] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:41.280844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:41.281762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:41.291000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:41.291739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:41.293037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:41.294307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:41.446880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:41.457504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3bc666c5-5bfe-4b65-8335-480703424eaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.183546 Jul 29 06:28:41.458969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 173/353] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:41 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:41.784390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:41.785258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:41.792370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:41.792851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:41.793798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:41.794234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:41.839643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:41.841690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:41.854358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:41.855172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:41.856520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:41.857200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:41.955026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:41.967061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-21a842a2-ac2c-4e6b-96a8-67e0167a3a7c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.186149 Jul 29 06:28:41.973005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 181/354] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:41 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:42.073757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:42.085153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:42.087352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:42.089452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6dcdab7b-e211-4dbc-9974-f355cd377bf6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.255647 Jul 29 06:28:42.090090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 174/355] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:42.494146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:42.495173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:42.516050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:42.516507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:42.517339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:42.517775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:42.738832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:42.762699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-41f49bb3-6e99-4ce0-9a58-2fb66962630f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.286009 Jul 29 06:28:42.764513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 182/356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:42 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:42.989600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:42.990323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:43.002289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:43.002749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:43.003546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:43.003987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:43.114148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:43.114785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:43.122419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:43.123088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:43.124063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:43.124689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:43.272632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:43.282917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f1f9e208-d954-4c60-9aed-e31a75f1e241 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.297551 Jul 29 06:28:43.286664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 175/357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:42 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:43.363947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:43.373760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:43.376224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:43.377444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-02812a25-be65-47c9-8648-02916a1b90c2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.268212 Jul 29 06:28:43.378002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 183/358] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:43.785638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:43.786166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:43.792309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:43.792801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:43.793697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:43.795313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:43.799558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:43.993488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:44.004435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cbd29690-48b8-4020-aee0-0896fc93e8ac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.222679 Jul 29 06:28:44.005425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 176/359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:43 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:44.313204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:44.313737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:44.322626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:44.323388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:44.324480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:44.326139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:44.404569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:44.405779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:44.412203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:44.412688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:44.413709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:44.414736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:44.485377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:44.493865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5bc3386f-857c-4da8-a84c-8bc2e826b796 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.186097 Jul 29 06:28:44.494759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 184/360] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:44 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:44.601566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:44.612914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:44.614419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:44.615584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-788886a4-7960-4113-b33f-a42aed993614 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1723 microversion: 2.20 time: 0.216686 Jul 29 06:28:44.632787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 177/361] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:45.025641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:45.026270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:45.033057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.033558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.034339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.034783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.170878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:45.182882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eea1a4d9-9b69-4847-9e18-cd4018220dc1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1501 microversion: 2.1 time: 0.161028 Jul 29 06:28:45.183703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 185/362] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:45 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:45.206115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb1de6ad-09d8-438a-9eaf-2e614edd6b2d"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:45.208979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:45.215934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.216775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.217801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.218417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.243244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] HTTP exception thrown: Cannot 'attach_volume' instance f5dc91c9-6f94-4b19-a397-19669b267c43 while it is in vm_state rescued Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Request method failure captured: Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/os-volume_attachments HTTP/1.1 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 74 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432aLpZNoxOpwzy03jMfkuifWw-eHjv1eAOVtBVJETSXTO1aHbVSf8HiqQOGd9XGEJ5u0X9ktb5_PN9hCinMSg3Jqx7H9cMj0kIca5tJ2GJ_6LXL8gEXuKhto7dIywdjwTBHUhr9qY3uTf3nn8kexXBRMtoTn9tqbT-PCc4Xh098BH4 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:28:45.245037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_872e2c13f9b346598c261de5609fdf89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: b34e3e2e2e6049428295588959ca595c Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {"volumeAttachment": {"volumeId": "eb1de6ad-09d8-438a-9eaf-2e614edd6b2d"}} Jul 29 06:28:45.247407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Cannot 'attach_volume' instance f5dc91c9-6f94-4b19-a397-19669b267c43 while it is in vm_state rescued Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'server_id': 'f5dc91c9-6f94-4b19-a397-19669b267c43', 'body': {'volumeAttachment': {'volumeId': 'eb1de6ad-09d8-438a-9eaf-2e614edd6b2d'}}} Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:28:45.248212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f5dc91c9-6f94-4b19-a397-19669b267c43 while it is in vm_state rescued Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:28:45.250638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f5dc91c9-6f94-4b19-a397-19669b267c43 while it is in vm_state rescued Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Returning 409 to user: Cannot 'attach_volume' instance f5dc91c9-6f94-4b19-a397-19669b267c43 while it is in vm_state rescued {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-69394aaa-313c-409a-986e-22ce0c240529 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044583 Jul 29 06:28:45.252042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 178/363] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 06:28:45 2022] POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 29 06:28:45.257808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:45.258400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:45.265896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.266483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.267529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.268136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.336763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-799c1742-aed0-479b-b8cb-cbba5cc4932d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/action" status: 202 len: 0 microversion: 2.1 time: 0.083189 Jul 29 06:28:45.337459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 186/364] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:28:45 2022] POST /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:28:45.346713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:45.347658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:45.356490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.356968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.357936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.358729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.516786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:45.517785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:45.529145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.529606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.530384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.530965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.652027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:45.663402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-66329497-84b9-4e96-a1f2-c42a8721a09f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1509 microversion: 2.1 time: 0.320571 Jul 29 06:28:45.666177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 179/365] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:45 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1509 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:45.671966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:45.673486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:45.677520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:45.683820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.684638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.686432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:45.687176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:45.689050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:45.698262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c7f1a2e3-a8db-4bb0-959f-f6b77fc4c48c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.186475 Jul 29 06:28:45.698926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 187/366] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:45 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:46.220630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:46.229462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:46.231436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:46.233162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5098288b-e3c3-4970-b91d-88d5f35d2a54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1744 microversion: 2.20 time: 0.565461 Jul 29 06:28:46.233733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 180/367] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1744 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:46.691466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:46.692151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:46.698785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:46.699237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:46.700258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:46.700739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:46.726802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:46.727844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:46.762254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:46.763364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:46.764433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:46.764910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:46.874234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:46.882368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5f16ac23-4b9e-47ff-b3d8-eed4e6728262 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1509 microversion: 2.1 time: 0.194884 Jul 29 06:28:46.890281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 188/368] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:46 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1509 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:46.950936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:46.959339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0ff54779-6883-463a-bdde-ffc16a141223 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.241463 Jul 29 06:28:46.959766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 181/369] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:46 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:47.257613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:47.258254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:47.279422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:47.280929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:47.282646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:47.283716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:47.452918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:47.462388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:47.463818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:47.465034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b8812352-61e7-4a90-8822-fae54dd19cbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1744 microversion: 2.20 time: 0.211270 Jul 29 06:28:47.466178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 189/370] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:47.905260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:47.906676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:47.921543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:47.925235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:47.926407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:47.935016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:47.984662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:47.986389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:47.995261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:47.996204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:47.997919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:47.998635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:48.266529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:48.271466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:48.281353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ce74a912-9ef1-4ae8-a2d5-d72874cfda6c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1509 microversion: 2.1 time: 0.381462 Jul 29 06:28:48.282046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 182/371] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:47 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1509 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:48.315126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7f91a01-a2aa-4ce1-aa8c-06a9866dd9c9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.330596 Jul 29 06:28:48.315758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 190/372] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:47 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:48.505336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:48.505974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:48.525280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:48.525940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:48.527322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:48.528141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:48.762829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:48.772426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:48.774326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:48.775617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-768dcba4-f53d-455d-85bd-1be1865e5c7b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1744 microversion: 2.20 time: 0.288487 Jul 29 06:28:48.776382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 183/373] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1744 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:49.308867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:49.315314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:49.322490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:49.322945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:49.323748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:49.326834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:49.358252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:49.359220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:49.379031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:49.379530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:49.380312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:49.381766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:49.579609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:49.590055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bd784f98-828a-4bab-9b07-9aee7daeb41a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1515 microversion: 2.1 time: 0.290450 Jul 29 06:28:49.592591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 191/374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:49 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:49.679040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:49.698245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1efbfa00-d8dc-42bb-8c1f-595f1c321e88 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.346220 Jul 29 06:28:49.700452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 184/375] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:49 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:49.802940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:49.804015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:49.820346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:49.822468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:49.827128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:49.827801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:50.167926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-7062e462-b637-4c01-b76a-45e86270ba7b req-ce58c36d-0314-4d20-a07c-13d6485125f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "name": "network-vif-plugged", "status": "completed", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:50.198052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-7062e462-b637-4c01-b76a-45e86270ba7b req-ce58c36d-0314-4d20-a07c-13d6485125f8 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:50.201350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-7062e462-b637-4c01-b76a-45e86270ba7b req-ce58c36d-0314-4d20-a07c-13d6485125f8 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:50.215758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:50.231217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:50.234180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:50.238161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fb41376d-3af9-4d7e-b5b3-f382125eb7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.441963 Jul 29 06:28:50.239708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 192/376] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:50.254956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-7062e462-b637-4c01-b76a-45e86270ba7b req-ce58c36d-0314-4d20-a07c-13d6485125f8 service nova] Creating event network-vif-plugged:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:28:50.264575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-7062e462-b637-4c01-b76a-45e86270ba7b req-ce58c36d-0314-4d20-a07c-13d6485125f8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099105 Jul 29 06:28:50.265662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 185/377] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:28:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:50.729001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:50.729973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:50.748429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:50.750295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:50.751682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:50.752409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:51.087830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:51.101167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a001e7e9-1d3a-4766-ba1c-44060c1b64c0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.377575 Jul 29 06:28:51.104747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 193/378] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:50 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:51.235602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24db1538-f2b7-4ceb-b90c-373737e69202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'create', calling method: .version_select at 0x7f145a431160>, body: {"keypair": {"name": "tempest-keypair-1146381832", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZF+re0JdqFzbzwS/BOFcgYRGEIUBe164FEn4kRpDG34lPzvb6paynmCZ5GqCQ58ocT0Dn7fuS8lfmpIZ2f+HqjYXbKqC6WvyyfXTP2SdTPedFc9thRWMOKhFgFf5MnSQ=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:51.273567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:51.274820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:51.295029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:51.295587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:51.296576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:51.297027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:51.300568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:51.308481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-24db1538-f2b7-4ceb-b90c-373737e69202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for project 872e2c13f9b346598c261de5609fdf89. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:28:51.319786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-24db1538-f2b7-4ceb-b90c-373737e69202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for user b34e3e2e2e6049428295588959ca595c and project 872e2c13f9b346598c261de5609fdf89. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:28:51.413386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24db1538-f2b7-4ceb-b90c-373737e69202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.185238 Jul 29 06:28:51.432712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 186/379] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 06:28:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:28:51.996363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:52.041239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:52.043195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:52.046030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-988f676c-c4c1-4327-8905-df6275de1f5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.781591 Jul 29 06:28:52.077261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 194/380] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:52.126014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:52.127055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:52.135763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:52.136135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:52.137494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:52.137929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:52.398459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:52.411193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c1f22ed-1a16-4450-93d0-1523ba11ce43 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.289024 Jul 29 06:28:52.425503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 187/381] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:52 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:53.073952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:53.076233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:53.084486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:53.085215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:53.086356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:53.086956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:53.439297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:53.443071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:53.456169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:53.457023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:53.459340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:53.460110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:53.468136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:53.483229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:53.484834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:53.490807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fde82ad9-d33c-4aa2-96b1-5b93838a8d01 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.423257 Jul 29 06:28:53.491672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 195/382] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:53.654310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:53.666865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b642ecf-e4a0-4c60-b3db-b327c293d356 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1725 microversion: 2.1 time: 0.236717 Jul 29 06:28:53.667887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 188/383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:53 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1725 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:54.520497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:54.521813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:54.530125 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:54.530883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:54.531901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:54.532575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:54.690682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:54.691905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:54.704295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:54.711924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:54.714384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:54.716094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:54.999175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:55.020858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:55.020858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:55.022845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b8817b5f-aa8e-488a-85c4-97f4338d647c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.506057 Jul 29 06:28:55.047155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 196/384] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:55.076174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1345147154", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8016328e-1678-4850-8f2e-16c509f3c821"}], "security_groups": [{"name": "tempest-securitygroup--620419548"}], "key_name": "tempest-keypair-1146381832", "user_data": "}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:55.249691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:55.266544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06661861-d4d0-4d4f-a418-05d4a5b0849a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1702 microversion: 2.1 time: 0.574739 Jul 29 06:28:55.279139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 189/385] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:54 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1702 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:28:55.304039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9915d520-e571-42af-a7db-dd70a3cb789c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:28:55.321808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9915d520-e571-42af-a7db-dd70a3cb789c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:55.322268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9915d520-e571-42af-a7db-dd70a3cb789c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:55.428303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9915d520-e571-42af-a7db-dd70a3cb789c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Going to try to start instance {{(pid=117958) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 06:28:55.502938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9915d520-e571-42af-a7db-dd70a3cb789c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action" status: 202 len: 0 microversion: 2.1 time: 0.214703 Jul 29 06:28:55.504059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 190/386] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:28:55 2022] POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:28:55.534153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:55.535006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:55.544011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:55.544994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:55.546091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:55.546727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:55.999352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:56.015333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-963a966e-d3a2-450d-bca0-ee3ca7090e7f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1711 microversion: 2.1 time: 0.496880 Jul 29 06:28:56.019705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 191/387] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:55 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1711 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:56.055782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:56.056673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:56.077996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:56.080318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:56.081728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:56.084945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:56.469151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] validate_networks() for [('8016328e-1678-4850-8f2e-16c509f3c821', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:28:56.500588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:56.512063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:56.525468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:56.531670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2fe0577e-d8d6-472d-a93c-9622fea669ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.479389 Jul 29 06:28:56.534781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 192/388] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:28:57.045161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:57.045990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:57.063655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:57.064161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:57.065102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:57.065961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:57.378641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:28:57.379075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:28:57.379549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:28:57.379963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:28:57.380382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:28:57.386511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:57.406699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:57.407158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:57.407968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:57.408406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:57.454870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for project 872e2c13f9b346598c261de5609fdf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:28:57.462957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Getting quotas for user b34e3e2e2e6049428295588959ca595c and project 872e2c13f9b346598c261de5609fdf89. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:28:57.489088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:28:57.491469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:28:57.602804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4431d387-555f-4919-a231-b1bc0d616de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.536175 Jul 29 06:28:57.605240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 197/389] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:28:55 2022] POST /compute/v2.1/servers => generated 408 bytes in 2539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:28:57.613301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:57.613915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:57.633711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:57.634214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:57.634991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:57.635431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:57.883147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:57.898512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:28:57.918553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9c413bdd-e33c-4090-aff1-d1ff5c846aee tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1711 microversion: 2.1 time: 0.879306 Jul 29 06:28:57.927551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 193/390] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:57 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1711 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:57.960644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1cfffd2a-57c1-4e96-99db-5ce861923f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:57.961664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1cfffd2a-57c1-4e96-99db-5ce861923f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:58.115287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:58.135702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:58.145039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:58.150349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cbddcdce-6a67-4b23-9235-9b467cfb4ae5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.540844 Jul 29 06:28:58.150762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 198/391] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:28:58.175107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1cfffd2a-57c1-4e96-99db-5ce861923f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:58.196024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1cfffd2a-57c1-4e96-99db-5ce861923f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1246 microversion: 2.1 time: 0.263159 Jul 29 06:28:58.196939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 194/392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1246 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:58.954080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:58.955439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:58.972008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:58.972777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:58.974016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:58.986123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:59.180827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:59.181443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:59.196993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:59.197441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:59.198257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:59.198669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:59.388575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:59.399430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e83555f9-c3df-4872-966d-e234d465102b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1715 microversion: 2.1 time: 0.450772 Jul 29 06:28:59.400013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 199/393] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:58 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1715 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:59.431258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:28:59.437532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:28:59.449690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:59.457419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:59.460767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:28:59.461406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:28:59.633972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:59.643494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6e4a3211-3899-4f42-a281-5956c2554679 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1298 microversion: 2.1 time: 0.223574 Jul 29 06:28:59.644077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 200/394] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:28:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1298 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:28:59.673150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:59.685795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:59.687323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:28:59.698157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d112cda-fc65-4230-b052-fcae856fe632 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.528873 Jul 29 06:28:59.702237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 195/395] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:28:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:00.673075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:00.673682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:00.695318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:00.700695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:00.708069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:00.712644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:00.748928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:00.752414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:00.765985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:00.767242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:00.769797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:00.770654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:00.890477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:00.901126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b36bffc-8d4b-46f3-a90d-96b2b4b8aca6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1304 microversion: 2.1 time: 0.232020 Jul 29 06:29:00.903086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 201/396] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1304 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:01.086160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:01.098041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:01.102512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:01.107092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c923a549-306f-42d0-9d2d-57249cbd03eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.377513 Jul 29 06:29:01.122557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 196/397] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:01.930153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:01.931404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:01.948607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:01.951987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:01.954321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:01.957410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:02.132089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:02.132757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:02.152642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:02.157257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:02.159495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:02.162065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:02.502113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:02.520945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0ba494b7-a2e6-4244-9971-9669b5754b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.594984 Jul 29 06:29:02.522187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 202/398] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:02.884069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:02.900454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:02.902863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:02.911534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-57a3b9a9-ed94-47fa-b8e7-e55da394c9d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.783931 Jul 29 06:29:02.912780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 197/399] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:03.446713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-26a0b2ca-d51b-497d-8a63-b45c0d1a9118 req-3a39a583-2a81-4af9-a8f2-730314e9ed26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c6cd3c-a26a-45fe-b507-9594b994002c", "tag": "0d3eecc6-30a2-46cd-95ea-608f50908f78"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:03.467046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-26a0b2ca-d51b-497d-8a63-b45c0d1a9118 req-3a39a583-2a81-4af9-a8f2-730314e9ed26 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:03.471673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-26a0b2ca-d51b-497d-8a63-b45c0d1a9118 req-3a39a583-2a81-4af9-a8f2-730314e9ed26 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:03.496245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-26a0b2ca-d51b-497d-8a63-b45c0d1a9118 req-3a39a583-2a81-4af9-a8f2-730314e9ed26 service nova] Creating event network-changed:0d3eecc6-30a2-46cd-95ea-608f50908f78 for instance e3c6cd3c-a26a-45fe-b507-9594b994002c on hv-cinder-83482 Jul 29 06:29:03.514818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-26a0b2ca-d51b-497d-8a63-b45c0d1a9118 req-3a39a583-2a81-4af9-a8f2-730314e9ed26 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067948 Jul 29 06:29:03.515474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 203/400] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:03.544576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:03.545992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:03.558046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:03.559708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:03.560757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:03.569478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:03.938790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:03.939741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:03.952920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:03.957248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:03.958633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:03.959268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:04.161111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:04.210630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c9c7fa16-30ba-4fbf-a680-aa2fbf14210c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.671112 Jul 29 06:29:04.211613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 198/401] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:04.369062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:04.381539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:04.383589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:04.385645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a593d7ac-dbef-416c-830c-1dde4692a6ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.453893 Jul 29 06:29:04.387872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 204/402] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:05.015122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35b18eb0-e0d8-4ae7-a787-c958466f5eb6", "device": "/dev/sdb"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:05.018157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:05.039651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:05.040113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:05.040930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:05.041372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:05.242970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:05.243749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:05.255274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:05.257224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:05.258223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:05.259859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:05.587187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:05.598624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2025dea4-2966-431b-9c6b-da42c6642cd4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.361573 Jul 29 06:29:05.599205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 205/403] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:05.625753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:05.632472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:05.645038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:05.645848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:05.655727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:05.656304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:06.011190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:06.021766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:06.026556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:06.028771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e671fe27-cefe-4b6a-b7c3-ddf5e5d1a1fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.412450 Jul 29 06:29:06.029956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 206/404] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:06.309937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-faeb7412-9f08-4d0c-8bac-3d971f5aff0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "POST /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.298176 Jul 29 06:29:06.311842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 199/405] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 06:29:05 2022] POST /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337/os-volume_attachments => generated 194 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:06.626623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:06.627171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:06.638338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:06.639046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:06.640635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:06.641381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:06.867983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:06.877033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-90b5ddbd-81e7-41e6-8bc2-0b850d27c2fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.256542 Jul 29 06:29:06.877923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 207/406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:07.055746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:07.056813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:07.068474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:07.069130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:07.070341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:07.070935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:07.830887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:07.845860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:07.853007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:07.854403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac781698-2359-4772-8018-1dee24f3edaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.803901 Jul 29 06:29:07.855615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 200/407] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:07.900096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:07.900778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:07.913444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:07.916440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:07.941976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:07.945808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:07.948603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:07.954254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:08.474289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:08.484793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d105385c-5db2-4784-9dc0-461a9a7190bd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.588796 Jul 29 06:29:08.487496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 208/408] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:08.882266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:08.884478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:08.888442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:08.903561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:08.904288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:08.906409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:08.908137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:09.204016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:09.223802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:09.234328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:09.236524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b99dc70f-f01d-44ad-9364-de07aef58f0f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.362172 Jul 29 06:29:09.242781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 201/409] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:09.513825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:09.517876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:09.531724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:09.532453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:09.533440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:09.534213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:09.949460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:09.958850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b4dbe257-a4eb-47bf-845b-0d9bbc9db00f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.450896 Jul 29 06:29:09.964971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 209/410] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:10.270081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:10.271287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:10.286585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:10.287398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:10.290905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:10.291579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:10.632571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:10.651795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:10.656146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:10.660622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c8231c77-590d-4b5f-ac7d-85df19ff13a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.394760 Jul 29 06:29:10.679324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 202/411] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:10.733004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-0740cc7e-4d76-463a-be7a-071fdb0a4bb0 req-b002b0b2-171e-4ce1-80ba-8fe09ebab8a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c6cd3c-a26a-45fe-b507-9594b994002c", "name": "network-vif-plugged", "status": "completed", "tag": "0d3eecc6-30a2-46cd-95ea-608f50908f78"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:10.769359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-0740cc7e-4d76-463a-be7a-071fdb0a4bb0 req-b002b0b2-171e-4ce1-80ba-8fe09ebab8a4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:10.770797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-0740cc7e-4d76-463a-be7a-071fdb0a4bb0 req-b002b0b2-171e-4ce1-80ba-8fe09ebab8a4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:10.807437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-0740cc7e-4d76-463a-be7a-071fdb0a4bb0 req-b002b0b2-171e-4ce1-80ba-8fe09ebab8a4 service nova] Creating event network-vif-plugged:0d3eecc6-30a2-46cd-95ea-608f50908f78 for instance e3c6cd3c-a26a-45fe-b507-9594b994002c on hv-cinder-83482 Jul 29 06:29:10.817528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-0740cc7e-4d76-463a-be7a-071fdb0a4bb0 req-b002b0b2-171e-4ce1-80ba-8fe09ebab8a4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094926 Jul 29 06:29:10.819158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 210/412] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:10.989363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:10.991255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:11.013100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:11.013559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:11.014359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:11.014798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:11.691914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:11.692651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:11.710762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:11.711225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:11.712048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:11.717166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:11.769881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:11.781693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5aa38074-cfb8-4f72-9287-d77356165323 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.798147 Jul 29 06:29:11.786490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 203/413] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:12.052582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:12.066604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:12.071386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:12.072980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bf32fbbb-54fa-4341-9ed9-a0e7c0a010e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.385268 Jul 29 06:29:12.087601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 211/414] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:12.807509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:12.809581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:12.816939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:12.816939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:12.817963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:12.829337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:13.071455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:13.081461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4001e965-6bc3-491a-9264-191f23e91d76 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.277419 Jul 29 06:29:13.082914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 204/415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:13.097743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:13.098349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:13.107913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:13.110190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:13.111940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:13.122042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:13.386814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:13.395033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:13.399654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:13.402497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:13.404050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-606babfd-2801-42c5-b01f-08fd1bcbd050 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.310176 Jul 29 06:29:13.405245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 212/416] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:13.474482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2862619-f770-485c-bd69-8fd35678c3dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Action: 'create', calling method: .version_select at 0x7f145a3d8b80>, body: {"keypair": {"name": "tempest-TestShelveInstance-1134720923", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVRLAGc9pAAMJDbryPGpnDqyHOYcCSOVAjI5ndE6c7cqm8YGmvL1U7XzeXiW7Yc9RIgSRloVCUYrfjfbpoCj3XEWHnn39CfRo+M7tQX1t+TYgKrr37dIOULVr/Hj3kogg=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:13.506945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-a2862619-f770-485c-bd69-8fd35678c3dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Getting quotas for project 6b5916906d6048bb96c13c457bf367e3. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:29:13.512475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-a2862619-f770-485c-bd69-8fd35678c3dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Getting quotas for user 1d436bd35f48454da2dc2e607247fe02 and project 6b5916906d6048bb96c13c457bf367e3. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:29:13.556502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2862619-f770-485c-bd69-8fd35678c3dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.433411 Jul 29 06:29:13.563623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 205/417] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 06:29:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:14.103716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:14.105830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:14.114960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:14.116136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:14.117456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:14.118241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:14.344071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:14.356811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b9eb15af-0c80-4fda-8043-21246bf4afb7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.255413 Jul 29 06:29:14.357834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 213/418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:14.432036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:14.435132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:14.448330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:14.449566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:14.450696 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:14.451727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:14.709120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:14.709120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:14.713984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:14.713984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f1e949ef-81a7-4597-ac5b-af2923cdca81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.282992 Jul 29 06:29:14.738718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 206/419] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:15.385538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:15.388106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:15.412804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:15.413387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:15.414242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:15.414671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:15.668114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:15.676400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-73fe7582-3f39-454b-9684-bfd601db933d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1371 microversion: 2.1 time: 0.295699 Jul 29 06:29:15.682134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 214/420] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:15.751903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:15.752507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:15.755053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:15.762615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:15.763401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:15.764612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:15.767839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:15.955678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:15.965372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:15.967606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:15.969123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6c8eaee2-393d-45f1-a633-f6e2241f7bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.224285 Jul 29 06:29:15.986131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 207/421] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:16.699637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:16.700370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:16.711414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:16.714019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:16.718033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:16.718703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:16.922141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:16.931410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-51485504-e0bd-4d4d-af14-9dcadc96dadc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1565 microversion: 2.1 time: 0.237585 Jul 29 06:29:16.932270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 215/422] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1565 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:29:16.963753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:16.967035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:16.976391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:16.977221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:16.978528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:16.980949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:16.992516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:16.993446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:17.004406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:17.005327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:17.007453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:17.008195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:17.102561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8754fa6e-2849-4a7f-9064-7243cbcf3f73 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.153730 Jul 29 06:29:17.103748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 208/423] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 06:29:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:17.471764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:17.486537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:17.488499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:17.490817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7cafa4df-79e7-4623-bc31-6d401bef5bf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1739 microversion: 2.20 time: 0.502090 Jul 29 06:29:17.492148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 216/424] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1739 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:18.520628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:18.521255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:18.527893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:18.528410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:18.529293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:18.529745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:18.779940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:18.788186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:18.789795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:18.790952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac78c382-5fbf-49a8-989c-5f1c627e8b44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.276502 Jul 29 06:29:18.791506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 209/425] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:18.947086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-89b26bd8-e80b-4d73-8cb4-dee9200159e7 req-d86f2d39-3b70-4361-991c-94b34fbaa1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c6cd3c-a26a-45fe-b507-9594b994002c", "tag": "0d3eecc6-30a2-46cd-95ea-608f50908f78"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:18.958245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-89b26bd8-e80b-4d73-8cb4-dee9200159e7 req-d86f2d39-3b70-4361-991c-94b34fbaa1d8 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:18.958700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-89b26bd8-e80b-4d73-8cb4-dee9200159e7 req-d86f2d39-3b70-4361-991c-94b34fbaa1d8 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:18.970651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-89b26bd8-e80b-4d73-8cb4-dee9200159e7 req-d86f2d39-3b70-4361-991c-94b34fbaa1d8 service nova] Creating event network-changed:0d3eecc6-30a2-46cd-95ea-608f50908f78 for instance e3c6cd3c-a26a-45fe-b507-9594b994002c on hv-cinder-83482 Jul 29 06:29:18.977134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-89b26bd8-e80b-4d73-8cb4-dee9200159e7 req-d86f2d39-3b70-4361-991c-94b34fbaa1d8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033693 Jul 29 06:29:18.977728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 217/426] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:19.814555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:19.815254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:19.824853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:19.825381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:19.826327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:19.826931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:19.963250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:19.972274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:19.973861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:19.975033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-53c4ccbe-81b1-4096-b8de-3eb7c1069e18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.164384 Jul 29 06:29:19.975735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 210/427] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:21.000205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:21.000958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:21.007167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:21.007617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:21.008371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:21.008838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:21.156892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:21.164810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:21.166311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:21.167693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d8f184b3-3fe5-42f7-8256-342a8badf595 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.172445 Jul 29 06:29:21.168241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 218/428] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:22.190797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:22.191358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:22.197801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:22.198279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:22.199162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:22.199595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:22.219681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:22.340603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:22.348867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:22.350793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:22.351941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-883949e5-6952-4a36-9564-b3cbad0ad395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.165239 Jul 29 06:29:22.352518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 211/429] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:23.376633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:23.377238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:23.383665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:23.384109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:23.384892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:23.385322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:23.526696 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:23.535087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:23.536634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:23.537798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-067d82d2-5c3f-40e7-b735-68f32b49f1e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.165045 Jul 29 06:29:23.538357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 219/430] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:24.562012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:24.562624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:24.565051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:24.570498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:24.570947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:24.571719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:24.572155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:24.703847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:24.713622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:24.715898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:24.717124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7ede98b1-2664-4ab3-ac5c-a0966dba6a5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.159935 Jul 29 06:29:24.717679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 212/431] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:25.435733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-4c78c843-f97f-4a5c-bc78-2dd78489f89b req-49d324e3-ed28-49e4-9a12-fbbb5eb358f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "name": "network-vif-unplugged", "status": "completed", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:25.446331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-4c78c843-f97f-4a5c-bc78-2dd78489f89b req-49d324e3-ed28-49e4-9a12-fbbb5eb358f5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:25.446782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-4c78c843-f97f-4a5c-bc78-2dd78489f89b req-49d324e3-ed28-49e4-9a12-fbbb5eb358f5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:25.459773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-4c78c843-f97f-4a5c-bc78-2dd78489f89b req-49d324e3-ed28-49e4-9a12-fbbb5eb358f5 service nova] Creating event network-vif-unplugged:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:29:25.467318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-4c78c843-f97f-4a5c-bc78-2dd78489f89b req-49d324e3-ed28-49e4-9a12-fbbb5eb358f5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036896 Jul 29 06:29:25.468411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 220/432] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:29:25.742590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:25.743406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:25.750776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:25.751414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:25.752725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:25.753461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:25.898713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:25.907520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:25.908992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:25.910152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bad002df-d139-476b-a400-4428b8de3005 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1721 microversion: 2.20 time: 0.173086 Jul 29 06:29:25.910701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 213/433] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:26.940767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:26.940767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:26.947704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:26.949087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:26.950132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:26.950593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.090455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:27.098551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:27.100052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:27.101256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eab97f5c-42f1-46a0-bb3b-3d00ae07cc77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1724 microversion: 2.20 time: 0.170880 Jul 29 06:29:27.101814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 221/434] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:27.124599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1257a903-4cf3-40fc-8def-05232cfba1f9"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:27.126965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:27.133503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:27.133956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.134716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:27.135152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.421506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33d30911-0820-4a96-95a6-c68b038ac9ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.301442 Jul 29 06:29:27.422116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 214/435] 10.222.0.33 () {62 vars in 1364 bytes} [Fri Jul 29 06:29:27 2022] POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 188 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:29:27.547046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:27.547779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:27.549781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:27.555227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:27.555687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.556460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:27.556932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.603236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117957) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 06:29:27.674920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7740ebee-d445-48a0-a6db-f73c7836dd17 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/action" status: 202 len: 0 microversion: 2.20 time: 0.131763 Jul 29 06:29:27.675811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 222/436] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Jul 29 06:29:27 2022] POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:29:27.684517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:27.685266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:27.695605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:27.696136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.697045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:27.697562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:27.859878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:27.868957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:27.871277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:27.872591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c1d2cb52-ee52-4fbb-b494-214b49cce94e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1810 microversion: 2.20 time: 0.192734 Jul 29 06:29:27.885448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 215/437] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1810 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:28.898297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:28.898910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:28.905827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:28.906281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:28.907040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:28.907479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:29.062703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:29.071342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:29.073606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:29.074740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-493da23f-350f-4747-ad94-3dece1c40365 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1750 microversion: 2.20 time: 0.180887 Jul 29 06:29:29.075297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 223/438] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:30.099047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:30.099649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:30.106307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:30.106747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:30.107495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:30.107925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:30.249265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:30.257807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:30.259327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:30.260562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a36bc26-2a84-46be-ad32-6388c1a28564 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.165249 Jul 29 06:29:30.261137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 216/439] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:31.284913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:31.285523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:31.292334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:31.292949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:31.293714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:31.294155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:31.421177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:31.429505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:31.431012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:31.432162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-64e5069c-962d-4bcb-865f-36b66304aa3b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.151105 Jul 29 06:29:31.433425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 224/440] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:32.455397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:32.456012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:32.462936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:32.463390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:32.464724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:32.465167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:32.619051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:32.628525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:32.630046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:32.631263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cde2b4a7-d0c7-41e7-8157-e54fdbb7d88b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.179806 Jul 29 06:29:32.631817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 217/441] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:33.654327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:33.654946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:33.661391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:33.661849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:33.662613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:33.663053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:33.796698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:33.805619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:33.807801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:33.809015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c01c4a8b-5d27-4f54-8288-36a0f1c0c247 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.158699 Jul 29 06:29:33.809571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 225/442] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:34.833493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:34.834119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:34.840786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:34.841241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:34.842032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:34.842471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:34.970084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:34.978381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:34.980392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:34.981576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6acbe8c4-31bb-49e3-bbcb-e45bb41b65c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.152266 Jul 29 06:29:34.982130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 218/443] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:36.005295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:36.005829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:36.013012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:36.013457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:36.014211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:36.014639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:36.142416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:36.150837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:36.152596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:36.153755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-818d661b-e227-4316-94a2-60f3c543ea25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.152445 Jul 29 06:29:36.154315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 226/444] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:37.176325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:37.176967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:37.184813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:37.185270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:37.186041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:37.186486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:37.324285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:37.333804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:37.335304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:37.336483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d592198b-f151-4600-a77a-f3b76a64a0eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1752 microversion: 2.20 time: 0.164038 Jul 29 06:29:37.337269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 219/445] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:38.363235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:38.363860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:38.379091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:38.379554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:38.380613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:38.381066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:38.543849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:38.553294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:38.554808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:38.555974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-adf887d0-e0d7-481d-b64b-b3119712ef08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.199272 Jul 29 06:29:38.556520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 227/446] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:39.580493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:39.581869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:39.598217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:39.599491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:39.608617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:39.612115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:39.828100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:39.843059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:39.846810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:39.848972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1c7b4931-4a3d-47f8-b504-d496281a44ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.272544 Jul 29 06:29:39.850636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 220/447] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:40.893028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:40.893665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:40.903803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:40.905024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:40.906161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:40.906863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:41.122772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:41.160619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:41.168551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:41.169953 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4d4c5a8a-cd50-4383-8740-4a73ec5dd544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.294415 Jul 29 06:29:41.170523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 228/448] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:42.200822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:42.201474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:42.209204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:42.209668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:42.210464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:42.210907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:42.351470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:42.360612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:42.362105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:42.363646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73a007d7-8738-48f2-a9fd-7e839125441f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.172423 Jul 29 06:29:42.372740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 221/449] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:43.388293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:43.388926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:43.395506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:43.395962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:43.396822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:43.397261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:43.539386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:43.541619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:43.549229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:43.550717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:43.551865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dde9b818-02ea-4af2-a210-049d5e817157 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.168219 Jul 29 06:29:43.552416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 229/450] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:44.578150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:44.578723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:44.585742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:44.586213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:44.587002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:44.587583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:44.738934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:44.748993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:44.750503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:44.751679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-31da9b78-858d-4226-86e2-118d11713236 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.177742 Jul 29 06:29:44.752246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 222/451] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:45.290017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:45.290613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:45.298501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:45.298945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:45.299704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:45.300135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:45.429085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lazy-loading 'services' on Instance uuid a4244f0f-2067-4323-b059-2b96798f8337 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:29:45.548455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac92b8b7-bae6-42a6-b91a-d891ece3ff2a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337/os-volume_attachments/35b18eb0-e0d8-4ae7-a787-c958466f5eb6" status: 202 len: 0 microversion: 2.1 time: 0.262483 Jul 29 06:29:45.549076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 230/452] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:29:45 2022] DELETE /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337/os-volume_attachments/35b18eb0-e0d8-4ae7-a787-c958466f5eb6 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:29:45.775466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:45.776934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:45.779608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=32 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:45.785970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:45.786540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:45.787398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:45.787944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:45.926937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:45.936651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:45.938153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:45.939323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c8d960f-082d-4839-bfd0-166c6fabb3f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.167972 Jul 29 06:29:45.939873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 223/453] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:46.965506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:46.966174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:46.973407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:46.973860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:46.974635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:46.975070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:47.140167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:47.149241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:47.150800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:47.152346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-69f858be-dcdc-42af-b5da-e2afdb70bbf8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.191589 Jul 29 06:29:47.153204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 231/454] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:48.177700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:48.178320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:48.188813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:48.189657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:48.190482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:48.190958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:48.332163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:48.348086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:48.349699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:48.350899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33eb07a4-965b-4bc5-bc6d-eb42560230ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.177152 Jul 29 06:29:48.351462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 224/455] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:49.375678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:49.376314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:49.382737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:49.383183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:49.383981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:49.384417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:49.517748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:49.526193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:49.527702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:49.528884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-da6749bc-f777-42b5-94d2-d33e21b4075f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.157246 Jul 29 06:29:49.529445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 232/456] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:50.551964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:50.552517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:50.559800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:50.560255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:50.561053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:50.561496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:50.581834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:50.698412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:50.706632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:50.708686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:50.709830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c167af3d-4828-4dba-816a-a9d1769ae2e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.161833 Jul 29 06:29:50.710382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 225/457] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:51.733398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:51.733918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:51.741733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:51.742186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:51.742948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:51.743386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:51.871519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:51.879904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:51.881437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:51.882594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6fb4e91a-8a4c-4a6f-b16c-b6e26fc3a761 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.153170 Jul 29 06:29:51.883149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 233/458] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:52.906311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:52.906911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:52.912905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:52.913338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:52.914089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:52.914522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:53.043252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:53.051566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:53.053071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:53.054242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f8ad5236-c216-408c-b417-e302cc6a5c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.151965 Jul 29 06:29:53.054796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 226/459] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:54.077781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:54.078424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:54.085011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:54.085467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:54.086235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:54.086678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:54.095117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:54.095596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:54.102059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:54.102514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:54.103302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:54.104564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:54.129659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:29:54.206824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f57c7baa-29c8-4a00-a973-9f5379728f62 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 204 len: 0 microversion: 2.1 time: 0.115240 Jul 29 06:29:54.207999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 227/460] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:29:54 2022] DELETE /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 06:29:54.217323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:54.218033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:54.221004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:54.223996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:54.224448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:54.225253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:54.227132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:54.230094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:54.231843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:54.233238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a5cebf5c-1095-433f-a2d3-092f03afc580 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.159537 Jul 29 06:29:54.248587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 234/461] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:54.359462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:54.366939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-437fef99-c2de-4722-bfdb-e621814ed24d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1514 microversion: 2.1 time: 0.154717 Jul 29 06:29:54.367506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 228/462] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:54 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:29:55.258043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:55.258659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:55.266046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:55.266501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:55.267263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:55.267701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:55.389394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:55.390229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:55.396970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:55.397488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:55.397777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:55.398380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:55.398882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:55.407225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:55.408879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:55.410038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c59b26b-e5eb-4af8-a376-265674040360 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.155922 Jul 29 06:29:55.410592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 235/463] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:55.530578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:55.538013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5fc38634-8fc5-4cc1-a3fb-1e6679b0951d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1514 microversion: 2.1 time: 0.153187 Jul 29 06:29:55.538569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 229/464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:55 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:29:55.633838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-994091911", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1134720923", "security_groups": [{"name": "tempest-secgroup-smoke-1451324991"}], "networks": [{"uuid": "f1007beb-e148-48d0-bca7-91d3de1551cb"}], "block_device_mapping_v2": [{"uuid": "06246d99-d656-4213-a571-146940aafb25", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:55.763934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] validate_networks() for [('f1007beb-e148-48d0-bca7-91d3de1551cb', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:29:56.132037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:29:56.132462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:29:56.132987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:29:56.133391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:29:56.133797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:29:56.142614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.143058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.143847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.144277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.161581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Getting quotas for project 6b5916906d6048bb96c13c457bf367e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:29:56.165513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Getting quotas for user 1d436bd35f48454da2dc2e607247fe02 and project 6b5916906d6048bb96c13c457bf367e3. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:29:56.224215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:29:56.226330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='06246d99-d656-4213-a571-146940aafb25',volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:29:56.372563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f35bc25-a86d-4940-a91a-a031430a40e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742412 Jul 29 06:29:56.373664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 236/465] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:29:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:29:56.384187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73177b8d-57d8-4e0b-8d9d-bb6b63c985c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:56.391086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73177b8d-57d8-4e0b-8d9d-bb6b63c985c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:56.434578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:56.435569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:56.443905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.444738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.445682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.446117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.472375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73177b8d-57d8-4e0b-8d9d-bb6b63c985c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:56.481339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73177b8d-57d8-4e0b-8d9d-bb6b63c985c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1088 microversion: 2.1 time: 0.100838 Jul 29 06:29:56.482345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 230/466] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1088 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:56.561504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:56.562125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:56.572110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.574927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.576022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.576658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.639570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:56.651457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:56.652778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:56.654155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c272f82-b498-46ae-afe4-55c2feb7ae11 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.224308 Jul 29 06:29:56.655313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 237/467] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:29:56.667432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-7033b3fa-f5f2-4d55-b5e8-2caf163248c7 req-6535a4a4-3d18-4ef5-8f20-89878f220a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4244f0f-2067-4323-b059-2b96798f8337", "name": "network-vif-deleted", "tag": "4a07cbcd-5d41-419d-a8bd-9dd0a79c3d41"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:29:56.685026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-7033b3fa-f5f2-4d55-b5e8-2caf163248c7 req-6535a4a4-3d18-4ef5-8f20-89878f220a6c service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:56.689217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-7033b3fa-f5f2-4d55-b5e8-2caf163248c7 req-6535a4a4-3d18-4ef5-8f20-89878f220a6c service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:56.717132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:56.718022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-7033b3fa-f5f2-4d55-b5e8-2caf163248c7 req-6535a4a4-3d18-4ef5-8f20-89878f220a6c service nova] Creating event network-vif-deleted:4a07cbcd-5d41-419d-a8bd-9dd0a79c3d41 for instance a4244f0f-2067-4323-b059-2b96798f8337 on hv-cinder-83482 Jul 29 06:29:56.723615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-7033b3fa-f5f2-4d55-b5e8-2caf163248c7 req-6535a4a4-3d18-4ef5-8f20-89878f220a6c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060602 Jul 29 06:29:56.724447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 238/468] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:29:56.741482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6bd73203-f6a7-49b1-b4f2-b1458608f156 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 200 len: 1472 microversion: 2.1 time: 0.186671 Jul 29 06:29:56.753504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 231/469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:56 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 1472 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:57.504039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:57.505021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:57.513870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:57.514250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:57.515012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:57.515443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:57.582915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:57.591436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-83cd745b-c373-409a-a42d-38063c84bf6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1186 microversion: 2.1 time: 0.092336 Jul 29 06:29:57.591991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 239/470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:57.678009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:57.678610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:57.685023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:57.685468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:57.686222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:57.686656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:57.765232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:57.766027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: a4244f0f-2067-4323-b059-2b96798f8337] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:57.768344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:29:57.775309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:57.776268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:57.777332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:57.777782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:57.793887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] HTTP exception thrown: Instance a4244f0f-2067-4323-b059-2b96798f8337 could not be found. Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Request method failure captured: Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 HTTP/1.1 Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi4339VGeUJG7YrxaGwlpu7_ElY95VP0bZOpOFgYQXiqfGwl7EzcV6jMD8j-Jmhd6DbjGZJ---rGo-hjy2Yd_8-6CtFHybCf7Cd6UeP4xuEkvcaACVqsvra5GcRwUgBUr72x3Q8u8bBLmN87jg1YTkl_vVhMAsFPPbdGX52E0CCd93QzM Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:29:57.796054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_002000e5606c46c29c87b0fa2fe68b3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 5e05c9bdfc114478b5d80f077b970d17 Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance a4244f0f-2067-4323-b059-2b96798f8337 could not be found. Jul 29 06:29:57.797690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'a4244f0f-2067-4323-b059-2b96798f8337'} Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4244f0f-2067-4323-b059-2b96798f8337 could not be found. Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:29:57.801708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4244f0f-2067-4323-b059-2b96798f8337 could not be found. Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4244f0f-2067-4323-b059-2b96798f8337 could not be found. Jul 29 06:29:57.803133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:29:57.804348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Returning 404 to user: Instance a4244f0f-2067-4323-b059-2b96798f8337 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:29:57.804348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-150e2ef9-021a-4200-a3ac-8b127cf433d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337" status: 404 len: 111 microversion: 2.1 time: 0.036543 Jul 29 06:29:57.804348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 240/471] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:57 2022] GET /compute/v2.1/servers/a4244f0f-2067-4323-b059-2b96798f8337 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:29:57.829197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:57.838823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:57.840821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:57.842270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-11301620-731b-496b-99ac-0476c44f6d3f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.168057 Jul 29 06:29:57.842932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 232/472] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:58.611500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:58.612205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:58.619678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:58.620330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:58.621184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:58.621621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:58.684761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:58.692401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bcacd122-31f2-40e3-ad69-2f9260225dfb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1204 microversion: 2.1 time: 0.085086 Jul 29 06:29:58.692992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 241/473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:29:58.866839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:58.868153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:58.875428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:58.875892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:58.876744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:58.877195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:59.015447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:59.024429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:59.026020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:59.027183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-02a0b033-f18b-427d-84f0-91b9b2fb9949 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.164695 Jul 29 06:29:59.027762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 233/474] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:29:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:29:59.715204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:29:59.715818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:29:59.722448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:59.722899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:59.723670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:29:59.724107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:29:59.852173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:29:59.860082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0316597f-a6e3-4ce9-8710-97e10edd4147 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1272 microversion: 2.1 time: 0.149882 Jul 29 06:29:59.860656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 242/475] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:29:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1272 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:00.050637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:00.051170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:00.058147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:00.058594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:00.059360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:00.059876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:00.194435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:00.202968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:00.204466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:00.205686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-22281029-f094-4415-9e40-a55974362bfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.158984 Jul 29 06:30:00.206224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 234/476] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:00.610946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:30:00.611169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:30:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:30:00.880976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:00.881579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:00.888724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:00.889179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:00.889946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:00.890387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:01.022918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:01.030810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-879059a9-8402-4186-8d9c-1e4983eb5cb2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1272 microversion: 2.1 time: 0.153852 Jul 29 06:30:01.031358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 243/477] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1272 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:01.229789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:01.230399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:01.236851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:01.237437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:01.238305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:01.238739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:01.376249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:01.385799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:01.387407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:01.388670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-151ba1f0-9e28-4ed3-8893-82972e695545 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.162751 Jul 29 06:30:01.389225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 235/478] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:30:02.051342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:02.053885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:02.063250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:02.064036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:02.064958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:02.065484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:02.223318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:02.233330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-56e94f41-8459-4489-837b-89116a4a7814 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.185767 Jul 29 06:30:02.234257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 244/479] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:02.282228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-1078797f-6e50-4ab8-a2b1-19c1924207d4 req-fbb93eeb-6ba6-4ba6-9765-1a628a8999ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edc82ad-0d5b-4b12-b5fa-e69548ffd732", "tag": "7771fb54-6e8f-4267-8251-b0e5ae9ed6bb"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:02.343966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1078797f-6e50-4ab8-a2b1-19c1924207d4 req-fbb93eeb-6ba6-4ba6-9765-1a628a8999ea service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:02.344769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-1078797f-6e50-4ab8-a2b1-19c1924207d4 req-fbb93eeb-6ba6-4ba6-9765-1a628a8999ea service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:02.363206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-1078797f-6e50-4ab8-a2b1-19c1924207d4 req-fbb93eeb-6ba6-4ba6-9765-1a628a8999ea service nova] Creating event network-changed:7771fb54-6e8f-4267-8251-b0e5ae9ed6bb for instance 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 on hv-cinder-83482 Jul 29 06:30:02.370689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-1078797f-6e50-4ab8-a2b1-19c1924207d4 req-fbb93eeb-6ba6-4ba6-9765-1a628a8999ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095381 Jul 29 06:30:02.372000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 236/480] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:30:02.412032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:02.412677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:02.436846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:02.437423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:02.441521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:02.442523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:02.731123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:02.743128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:02.748005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:02.749557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-71647dce-c65c-4889-866f-17787207c609 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.341536 Jul 29 06:30:02.750669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 245/481] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:03.255972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:03.256944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:03.264437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:03.265128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:03.266088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:03.266779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:03.513418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:03.523832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06ebf8b4-7b6c-4bb2-94b3-3dd6f8aab4eb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.272180 Jul 29 06:30:03.524445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 237/482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:03.773099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:03.773823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:03.789392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:03.789392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:03.789392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:03.789392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:03.918085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:03.926729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:03.928270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:03.929479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b8683173-2c33-4e9f-94b9-b8634a8d2c21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.160602 Jul 29 06:30:03.930036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 246/483] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:04.546060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:04.546596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:04.553072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:04.553527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:04.554279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:04.554717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:04.685875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:04.693386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-56eaec78-bf2f-42cf-93fc-45b940c403ee tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.151190 Jul 29 06:30:04.693951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 238/484] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:04.954309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:04.954977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:04.961698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:04.962147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:04.963555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:04.963994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:05.100035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:05.102350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:05.111193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:05.112746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:05.115078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-99b1035c-1435-4a8a-bc8e-71a29a008ff0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.163666 Jul 29 06:30:05.115652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 247/485] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:30:05.714828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:05.715527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:05.721876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:05.722603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:05.723385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:05.723948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:05.865765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:05.874752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05cf3af9-67f5-4f92-b282-85323552d764 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.164360 Jul 29 06:30:05.875401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 239/486] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:06.141268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:06.141812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:06.148196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:06.148669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:06.149418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:06.150026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:06.153851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:06.179000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:06.279539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:06.287781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:06.289326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:06.290547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e3b0ae31-d3a1-4486-bdda-71862f6dc177 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.153599 Jul 29 06:30:06.291269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 248/487] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:06.896032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:06.897558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:06.898558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1500999867", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "networks": [{"uuid": "9fb54aae-ec14-47a4-acd6-caf395f03637"}]}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:06.904329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:06.907375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:06.908128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:06.909299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:06.909736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:06.958156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] validate_networks() for [('9fb54aae-ec14-47a4-acd6-caf395f03637', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:30:07.049832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:07.058419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fe09f8ce-c406-4dec-8697-d68a47dd6e9f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.166926 Jul 29 06:30:07.058992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 240/488] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:07.310518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:30:07.310962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:30:07.311402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:30:07.311808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:30:07.312215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:30:07.313591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:07.314202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:07.320327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:07.320811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:07.321592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:07.322246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:07.322360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:07.322883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:07.323682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:07.324115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:07.341208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Getting quotas for project 002000e5606c46c29c87b0fa2fe68b3c. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:30:07.345926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Getting quotas for user 5e05c9bdfc114478b5d80f077b970d17 and project 002000e5606c46c29c87b0fa2fe68b3c. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:30:07.358055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:30:07.360286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:30:07.407377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-04b3083c-37c7-4c2e-ab28-88493bc3df16 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512645 Jul 29 06:30:07.412690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 249/489] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:30:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 06:30:07.421073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8c98707b-05e6-4add-8107-e4704a668cc6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:07.421839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8c98707b-05e6-4add-8107-e4704a668cc6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:07.465624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:07.475581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:07.477124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:07.478990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-74c07491-b3e0-4624-b768-6589fb5a2c8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.169331 Jul 29 06:30:07.479729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 241/490] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:30:07.483262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8c98707b-05e6-4add-8107-e4704a668cc6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:07.490376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8c98707b-05e6-4add-8107-e4704a668cc6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1219 microversion: 2.1 time: 0.073033 Jul 29 06:30:07.490920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 250/491] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:07 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:08.085286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:08.085912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:08.097885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:08.098372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:08.099183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:08.099611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:08.104728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:08.235488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:08.243312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ed602c1-6774-442d-a678-c5a63b71f5fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.168139 Jul 29 06:30:08.244471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 242/492] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:08.502712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:08.503332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:08.511830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:08.512283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:08.513078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:08.513511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:08.515970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:08.516710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:08.522974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:08.523506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:08.524369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:08.526232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:08.596439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:08.605201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c4868289-6590-4b7d-820f-90a5bfd61e1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1279 microversion: 2.1 time: 0.092966 Jul 29 06:30:08.605703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 243/493] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:08 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1279 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:08.658882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:08.667639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:08.669175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:08.670330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b0ee9ec-2d41-447c-8133-e3d778917213 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.171578 Jul 29 06:30:08.670889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 251/494] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:09.098997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-bd842a4a-4b61-4084-a7c8-18a8c6230a18 req-9de679b2-abcb-422a-8ba4-b1d638d041a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "name": "network-vif-plugged", "status": "completed", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:09.109377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-bd842a4a-4b61-4084-a7c8-18a8c6230a18 req-9de679b2-abcb-422a-8ba4-b1d638d041a5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.109822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-bd842a4a-4b61-4084-a7c8-18a8c6230a18 req-9de679b2-abcb-422a-8ba4-b1d638d041a5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.123778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-bd842a4a-4b61-4084-a7c8-18a8c6230a18 req-9de679b2-abcb-422a-8ba4-b1d638d041a5 service nova] Creating event network-vif-plugged:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:30:09.129396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-bd842a4a-4b61-4084-a7c8-18a8c6230a18 req-9de679b2-abcb-422a-8ba4-b1d638d041a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034036 Jul 29 06:30:09.130509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 244/495] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:30:09.265911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:09.267042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:09.273581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.275803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.276819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.277633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.418904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:09.426223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-29311f16-d043-4ae8-843f-30b2e6487ac5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.164699 Jul 29 06:30:09.426787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 252/496] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:09.627293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:09.628582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:09.636389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.637117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.637897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.638330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.668724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:09.670245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:09.677304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.677876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.678757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.679277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.715812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:09.724143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b93b18cc-b0f2-4724-98e9-80e178c5bd81 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1277 microversion: 2.1 time: 0.101558 Jul 29 06:30:09.724987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 245/497] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:09.731089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:09.731791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:09.744916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.745679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.746699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:09.747301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:09.788697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lazy-loading 'services' on Instance uuid c0f47fa5-72de-4c83-a201-89fb8435978e {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:30:09.876404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-15712572-8502-45b8-9834-60b1b1091177 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-volume_attachments/7cfc7f11-2b7a-49d0-8d6c-c9235e799c0b" status: 202 len: 0 microversion: 2.1 time: 0.213693 Jul 29 06:30:09.877049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 253/498] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:30:09 2022] DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-volume_attachments/7cfc7f11-2b7a-49d0-8d6c-c9235e799c0b => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:30:09.956652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:09.966679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:09.968280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:09.969651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f9e21e80-fb1f-42ec-b5b5-0a68b14010f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.243496 Jul 29 06:30:09.970470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 246/499] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:10.448298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:10.449060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:10.455341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:10.455798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:10.456584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:10.457334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:10.596302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:10.604002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f3592c6f-28d8-463f-9c88-312a449cb754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.160613 Jul 29 06:30:10.605055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 254/500] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:10.745506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:10.746272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:10.752860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:10.753397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:10.754238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:10.754752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:11.011815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:11.011815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:11.013862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:11.015490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:11.015957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:11.022021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-258a9be0-66b6-4629-a484-11fd11d4b318 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.280272 Jul 29 06:30:11.024126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:11.024670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:11.036591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 247/501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:11.174392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:11.185605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:11.187381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:11.188798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0a9396ab-bf3f-4a80-8666-a5366c537649 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.199677 Jul 29 06:30:11.189530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 255/502] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:30:11.567706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-30ff4c5e-d374-49e6-8967-a208afbb518a req-c91a3312-d024-4b1e-bb2a-a43840204f95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "862582d7-9f21-4209-b495-59dfe7509df0", "tag": "1d15d9c9-1fdb-4575-820e-c126c0ed046d"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:11.578469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-30ff4c5e-d374-49e6-8967-a208afbb518a req-c91a3312-d024-4b1e-bb2a-a43840204f95 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:11.579039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-30ff4c5e-d374-49e6-8967-a208afbb518a req-c91a3312-d024-4b1e-bb2a-a43840204f95 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:11.593815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-30ff4c5e-d374-49e6-8967-a208afbb518a req-c91a3312-d024-4b1e-bb2a-a43840204f95 service nova] Creating event network-changed:1d15d9c9-1fdb-4575-820e-c126c0ed046d for instance 862582d7-9f21-4209-b495-59dfe7509df0 on hv-cinder-83482 Jul 29 06:30:11.598504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-30ff4c5e-d374-49e6-8967-a208afbb518a req-c91a3312-d024-4b1e-bb2a-a43840204f95 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042994 Jul 29 06:30:11.599507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 248/503] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:30:11.625477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:11.626092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:11.633165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:11.633916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:11.635054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:11.635655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.046182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:12.047511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:12.082975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.087810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.090178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.092065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.157369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:12.165448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bddeed0d-7da3-4bf8-b6af-8967720b4953 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.543621 Jul 29 06:30:12.166256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 256/504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:12.171697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e8a4e365-34a0-41f3-bd1d-7ca25d195647 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:12.202932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8a4e365-34a0-41f3-bd1d-7ca25d195647 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.203774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8a4e365-34a0-41f3-bd1d-7ca25d195647 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.259783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e8a4e365-34a0-41f3-bd1d-7ca25d195647 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Going to try to stop instance {{(pid=117957) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 06:30:12.323183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e8a4e365-34a0-41f3-bd1d-7ca25d195647 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action" status: 202 len: 0 microversion: 2.1 time: 0.154352 Jul 29 06:30:12.324660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 257/505] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:30:12 2022] POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:30:12.351610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:12.354618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:12.359312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:12.363405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.364004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.365150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.366022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.366709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1ccffa53-a3a6-4d82-aed7-e593792c9b24 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.327084 Jul 29 06:30:12.376898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 249/506] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:12 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:12.381908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:12.382469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:12.396343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.396842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.397694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:12.398217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:12.684638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:12.699704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:12.702199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:12.704054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-72ff884a-8fe1-4569-9443-eeaebc7498a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1808 microversion: 2.20 time: 0.375114 Jul 29 06:30:12.704916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 258/507] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1808 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:12.955483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:12.971071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b7fb8c85-5840-4e8f-bf7f-8ebbb00064f5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.592861 Jul 29 06:30:12.971969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 250/508] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:12 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:13.178585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-f5f800ed-df39-4a97-a8fa-262a4a8dfa8b req-1378b0f6-9652-4da2-9d8a-3769c054cd5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edc82ad-0d5b-4b12-b5fa-e69548ffd732", "name": "network-vif-plugged", "status": "completed", "tag": "7771fb54-6e8f-4267-8251-b0e5ae9ed6bb"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:13.201403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-f5f800ed-df39-4a97-a8fa-262a4a8dfa8b req-1378b0f6-9652-4da2-9d8a-3769c054cd5b service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.202151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-f5f800ed-df39-4a97-a8fa-262a4a8dfa8b req-1378b0f6-9652-4da2-9d8a-3769c054cd5b service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.210885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:13.213593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:13.232518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-f5f800ed-df39-4a97-a8fa-262a4a8dfa8b req-1378b0f6-9652-4da2-9d8a-3769c054cd5b service nova] Creating event network-vif-plugged:7771fb54-6e8f-4267-8251-b0e5ae9ed6bb for instance 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 on hv-cinder-83482 Jul 29 06:30:13.246407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-f5f800ed-df39-4a97-a8fa-262a4a8dfa8b req-1378b0f6-9652-4da2-9d8a-3769c054cd5b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070966 Jul 29 06:30:13.247328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 259/509] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:30:13.272883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.276706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.285297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.285946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.389932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:13.390911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:13.398255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.398911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.400688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.401356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.521573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:13.531164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cb7660de-f3a7-4833-81e5-6c6071ed339f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.344820 Jul 29 06:30:13.532083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 251/510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:13.575703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:13.586005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-85c50a6d-e93f-4542-9605-33c674810080 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.200639 Jul 29 06:30:13.592952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 260/511] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:13 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:13.729146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:13.729780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:13.736687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.737136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.737892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:13.738327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:13.873548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:13.882436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:13.884516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:13.885700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-42cc855f-5f53-4ef9-8bd7-6d0229d1ead0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1795 microversion: 2.20 time: 0.160587 Jul 29 06:30:13.886254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 252/512] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:30:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1795 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:30:13.993522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:13.994111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:14.000068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:14.000518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:14.001318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:14.001752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:14.134877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:14.142499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b290835f-947c-475f-9274-c83491d03acf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.152840 Jul 29 06:30:14.143053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 261/513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:13 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:14.552068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:14.552636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:14.560499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:14.560986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:14.562206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:14.562652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:14.607741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:14.608480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:14.615087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:14.615644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:14.616505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:14.617042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:14.760080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:14.768003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-faeb30d1-b2ff-4624-b77e-e41a095fcc35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.220325 Jul 29 06:30:14.769112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 253/514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:14.775205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:14.783269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e79157c8-007a-4467-b126-bb61c0c05672 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.179300 Jul 29 06:30:14.783847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 262/515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:14 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:15.163201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:15.163807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:15.170449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:15.170897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:15.171650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:15.172086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:15.298545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:15.306518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c3bf50bf-90a9-4425-aeb4-554f15a1a1a3 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.146661 Jul 29 06:30:15.309538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 254/516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:15 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:15.788849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:15.789457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:15.796092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:15.796558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:15.797306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:15.797738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:15.804446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:15.805087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:15.808143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:15.813579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:15.813579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:15.814331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:15.814771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:15.959970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:15.969232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:15.970006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7977e1d-6771-44b7-a10d-29c3431e0701 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1260 microversion: 2.1 time: 0.184976 Jul 29 06:30:15.970636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 263/517] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:15.981130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9106f978-3e84-4fb6-a898-9091ae6f9d64 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.180288 Jul 29 06:30:15.981699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 255/518] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:15 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:16.327542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:16.328151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:16.334502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:16.334946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:16.335729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:16.336167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:16.473481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:16.481693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7013d41a-7f93-4550-9e01-6c969ce65755 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.158170 Jul 29 06:30:16.482250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 264/519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:16 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:16.994998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:16.997452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:17.005172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:17.005592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.006062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:17.006196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.007186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.007700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.013295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.013837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.015675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.016360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.050129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:17.169606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:17.177911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59491ebf-3049-468b-9115-5b6d4903e1de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1445 microversion: 2.1 time: 0.186699 Jul 29 06:30:17.179310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 256/520] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1445 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:17.202470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:17.203399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:17.204529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:17.211616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.213734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-92f39a5c-e189-4600-affa-935e4877a7a8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.215392 Jul 29 06:30:17.214656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 265/521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:17.216135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.217162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.217749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.366062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:17.375180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f249319-7541-438c-9e11-4e4195713afd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1445 microversion: 2.1 time: 0.179631 Jul 29 06:30:17.375775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 257/522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1445 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:17.504605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:17.505474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:17.514040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:17.515128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=8 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:17.517151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.518373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.519460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:17.520663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:17.690972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:17.700916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-409c81b3-325a-4350-91e3-6964e6a6cc89 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.201222 Jul 29 06:30:17.702028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 266/523] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:17 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:18.236561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:18.237220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:18.243757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:18.244209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:18.245015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:18.245457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:18.379617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:18.387711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-69e1dd2b-d9b8-4ef2-9825-ac41a6ce7aaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.154944 Jul 29 06:30:18.388231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 258/524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:18 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:18.723330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:18.724030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:18.731698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:18.732146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:18.733021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:18.733651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:18.904843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:18.912809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ed7096f9-9242-415e-b4bd-b083332a9fe4 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.193280 Jul 29 06:30:18.913389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 267/525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:18 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:19.119790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-0d86f194-dddf-4046-8578-44749e4a80d1 req-6498bdd0-a1f0-4ca6-91e3-74f7069042f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862582d7-9f21-4209-b495-59dfe7509df0", "name": "network-vif-plugged", "status": "completed", "tag": "1d15d9c9-1fdb-4575-820e-c126c0ed046d"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:19.131038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0d86f194-dddf-4046-8578-44749e4a80d1 req-6498bdd0-a1f0-4ca6-91e3-74f7069042f4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:19.131557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0d86f194-dddf-4046-8578-44749e4a80d1 req-6498bdd0-a1f0-4ca6-91e3-74f7069042f4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:19.149123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-0d86f194-dddf-4046-8578-44749e4a80d1 req-6498bdd0-a1f0-4ca6-91e3-74f7069042f4 service nova] Creating event network-vif-plugged:1d15d9c9-1fdb-4575-820e-c126c0ed046d for instance 862582d7-9f21-4209-b495-59dfe7509df0 on hv-cinder-83482 Jul 29 06:30:19.155411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-0d86f194-dddf-4046-8578-44749e4a80d1 req-6498bdd0-a1f0-4ca6-91e3-74f7069042f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039380 Jul 29 06:30:19.156242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 259/526] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:30:19.415975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:19.416920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:19.423668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:19.424328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:19.425433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:19.425968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:19.525828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-52d19d7f-1cbf-4b02-9aad-04b7a58d3f07 req-cc650033-34f4-408d-a6a8-171c905884ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edc82ad-0d5b-4b12-b5fa-e69548ffd732", "tag": "7771fb54-6e8f-4267-8251-b0e5ae9ed6bb"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:19.535846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-52d19d7f-1cbf-4b02-9aad-04b7a58d3f07 req-cc650033-34f4-408d-a6a8-171c905884ab service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:19.536296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-52d19d7f-1cbf-4b02-9aad-04b7a58d3f07 req-cc650033-34f4-408d-a6a8-171c905884ab service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:19.548248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-52d19d7f-1cbf-4b02-9aad-04b7a58d3f07 req-cc650033-34f4-408d-a6a8-171c905884ab service nova] Creating event network-changed:7771fb54-6e8f-4267-8251-b0e5ae9ed6bb for instance 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 on hv-cinder-83482 Jul 29 06:30:19.553553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-52d19d7f-1cbf-4b02-9aad-04b7a58d3f07 req-cc650033-34f4-408d-a6a8-171c905884ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033065 Jul 29 06:30:19.554169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 260/527] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:30:19.588518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:19.596144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b28a5b92-8a6d-481d-a1ec-f86f9a95ccb1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1319 microversion: 2.1 time: 0.184542 Jul 29 06:30:19.596753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 268/528] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:19 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:19.935432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:19.936363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:19.942602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:19.943064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:19.943839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:19.944281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:19.963787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:20.075935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:20.083842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e6a119d9-7730-49a4-8ceb-918102d445fc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.152896 Jul 29 06:30:20.084413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 261/529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:19 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:20.617638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:20.618966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:20.625649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:20.626174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:20.627017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:20.627545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:20.763523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:20.770888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-da04e85a-ae01-4aed-b7e6-69b0f8b36dd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1508 microversion: 2.1 time: 0.157150 Jul 29 06:30:20.771475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 269/530] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:20 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:20.791717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c07dc3b-d032-4343-a61e-d874a8fb99e8", "device": "/dev/sdb"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:20.794172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:20.800614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:20.801065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:20.801820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:20.802254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:21.105041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:21.105758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:21.112655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:21.113577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:21.114360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:21.115208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:21.115479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3db2d26c-7e37-438f-9488-fad2105668cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "POST /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328095 Jul 29 06:30:21.116086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 262/531] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 06:30:20 2022] POST /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments => generated 194 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:30:21.254642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:21.262373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c218f84-bb6d-4116-87ee-59232ee134ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.161932 Jul 29 06:30:21.263135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 270/532] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:21 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:21.758108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da63a72f-85cd-4992-9bbe-5a021040ec7a"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:21.761132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:21.767498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:21.768033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:21.768843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:21.769287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:22.007629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-40318302-e6b2-416d-a3f6-7fd87379f21e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254087 Jul 29 06:30:22.008252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 263/533] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 06:30:21 2022] POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:30:22.285030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:22.285662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:22.292315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:22.292791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:22.293545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:22.293976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:22.423736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:22.435063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-62c4163b-43ca-4333-9319-eb5a6f84ce4c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.154215 Jul 29 06:30:22.435630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 271/534] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:22 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:23.456692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:23.457392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:23.464977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:23.465428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:23.466191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:23.466630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:23.597028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:23.604809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68a33826-2775-4724-8b2c-845d251dd2cf tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.152371 Jul 29 06:30:23.605367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 264/535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:23 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:24.626208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:24.626841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:24.632842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:24.633288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:24.634545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:24.634971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:24.768229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:24.775732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fdc0ba56-d3f6-4a8a-832d-a7c10f5dc20a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.153869 Jul 29 06:30:24.776289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 272/536] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:24 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:25.796662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:25.797271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:25.803783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:25.804228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:25.805067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:25.805499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:25.935998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:25.943414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5bb67c8-d460-446c-909e-3e88c304eebd tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.150595 Jul 29 06:30:25.943973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 265/537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:25 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:26.964843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:26.965488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:26.971954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:26.972404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:26.973190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:26.973623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:27.106774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:27.114188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-deba8e1c-9357-4449-9211-70f83a90d6e2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1679 microversion: 2.1 time: 0.153760 Jul 29 06:30:27.114740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 273/538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:26 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:28.135568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:28.136180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:28.144920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:28.145369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:28.146139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:28.146574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:28.286925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:28.295016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33a26438-e1d5-4ba0-a0dc-20d825e3b63e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1656 microversion: 2.1 time: 0.163793 Jul 29 06:30:28.295543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 266/539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:28 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:30:28.315202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9bbd3ffb-c376-47ad-95f2-d52bddcd996d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:30:28.322302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bbd3ffb-c376-47ad-95f2-d52bddcd996d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:28.322753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bbd3ffb-c376-47ad-95f2-d52bddcd996d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:28.344909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9bbd3ffb-c376-47ad-95f2-d52bddcd996d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Going to try to start instance {{(pid=117957) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 06:30:28.388392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9bbd3ffb-c376-47ad-95f2-d52bddcd996d tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action" status: 202 len: 0 microversion: 2.1 time: 0.076990 Jul 29 06:30:28.389348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 274/540] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:30:28 2022] POST /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:30:28.397420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:28.398171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:28.406402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:28.407222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:28.408532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:28.408772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:28.584321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:28.592124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3029b733-cb15-4bf3-9743-febf8af89e07 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1665 microversion: 2.1 time: 0.198788 Jul 29 06:30:28.592719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 267/541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:28 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1665 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:29.614714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:29.615411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:29.617699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:29.624480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:29.624986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:29.625763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:29.626194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:29.768008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:29.776297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b144c231-2fcc-41df-b1b7-7298c8f02f4e tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1665 microversion: 2.1 time: 0.166386 Jul 29 06:30:29.777236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 275/542] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:29 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:30.798360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:30.799105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:30.806719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:30.807353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:30.808423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:30.808616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:30.951359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:30.959409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-63b801ff-9c49-4147-907e-50632c51f3c8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1665 microversion: 2.1 time: 0.164971 Jul 29 06:30:30.959976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 268/543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:30 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1665 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:31.981451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:31.983055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:31.989983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:31.990432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:31.991194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:31.991627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:32.127766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:32.137235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3ee67407-ad99-4fca-a198-de6c4088e969 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1665 microversion: 2.1 time: 0.160331 Jul 29 06:30:32.137837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 276/544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:31 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:33.157939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:33.158541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:33.165440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:33.165920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:33.166686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:33.167111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:33.305447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:30:33.313382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-52e7767d-8383-48a8-9266-6c6574af44c1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1669 microversion: 2.1 time: 0.159360 Jul 29 06:30:33.314831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 269/545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:30:33 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1669 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:30:55.627684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:55.628264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:55.631349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:55.631349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:55.636926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:55.637371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:55.638133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:55.638570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:55.668984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-929960ba-76e1-49f0-b268-2dc3409f17ed tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments/1257a903-4cf3-40fc-8def-05232cfba1f9" status: 200 len: 194 microversion: 2.20 time: 0.045210 Jul 29 06:30:55.669558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 277/546] 10.222.0.33 () {60 vars in 1454 bytes} [Fri Jul 29 06:30:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments/1257a903-4cf3-40fc-8def-05232cfba1f9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:30:55.737656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:55.738151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:55.740726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=29 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:55.741376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:30:55.747197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:55.747641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:55.748401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:55.748879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:55.872910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lazy-loading 'services' on Instance uuid 6e189d03-298a-49f1-8edc-ee412247810f {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:30:55.984053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4458f313-78b5-49a8-9436-c35658dd7bc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments/1257a903-4cf3-40fc-8def-05232cfba1f9" status: 202 len: 0 microversion: 2.20 time: 0.250115 Jul 29 06:30:55.984697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 270/547] 10.222.0.33 () {60 vars in 1457 bytes} [Fri Jul 29 06:30:55 2022] DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments/1257a903-4cf3-40fc-8def-05232cfba1f9 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:30:55.993296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:55.995699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:56.001673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:56.002117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:56.002860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:56.003292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:56.032445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5db23a12-bba2-4186-aa59-4391d33de15b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043238 Jul 29 06:30:56.033013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 278/548] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:30:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:30:57.046421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:57.048731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:57.059136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:57.059580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:57.060336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:57.060804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:57.090094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-215e9081-51b5-4882-8cdf-0d71f3714a74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048875 Jul 29 06:30:57.090635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 271/549] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:30:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:30:58.102430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:58.104740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:58.111123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:58.111575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:58.112334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:58.112802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:58.141174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-93152735-e004-4a68-b17e-c74345b505cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042660 Jul 29 06:30:58.141754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 279/550] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:30:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:30:59.153972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:30:59.156207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:30:59.162667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:59.163117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:59.163881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:30:59.164318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:30:59.193371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0728a1dd-cfa7-4256-ab8b-12ec2b417b31 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043929 Jul 29 06:30:59.193911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 272/551] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:30:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:00.205809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:00.208185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:00.215194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:00.215641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:00.216402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:00.216872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:00.245790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5aa6b766-5f41-4932-8721-291a5b0cc276 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043800 Jul 29 06:31:00.246444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 280/552] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:01.258329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:01.260506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:01.267130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:01.267579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:01.268339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:01.268804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:01.297951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d319529f-17d3-47f1-85bb-8828a391b381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043651 Jul 29 06:31:01.298539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 273/553] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:02.310767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:02.312893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:02.319402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:02.319874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:02.320665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:02.321098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:02.350167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e57bac13-ff90-41b9-ab5f-cac3dd9ade83 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043894 Jul 29 06:31:02.350706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 281/554] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:03.362556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:03.364694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:03.371292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:03.371745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:03.372500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:03.372970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:03.401291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1a191a0-da38-4f09-ab66-8078cfdb0697 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042767 Jul 29 06:31:03.401862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 274/555] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:04.414547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:04.416675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:04.423318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:04.423769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:04.424525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:04.424994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:04.454296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-631e09f8-47c8-4acc-977e-1355dee478f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043682 Jul 29 06:31:04.454842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 282/556] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:05.466773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:05.468869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:05.475239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:05.475688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:05.476447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:05.476913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:05.506019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d614fc63-6d8d-4ba6-babc-bdce59aea9d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043314 Jul 29 06:31:05.506544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 275/557] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:06.518380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:06.520471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:06.527237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:06.527790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:06.528586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:06.529288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:06.563309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-485369cd-69c8-4539-b32b-1c772acf5529 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048865 Jul 29 06:31:06.563866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 283/558] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:07.576180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:07.579203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:07.586744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:07.587200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:07.587979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:07.588423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:07.622503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-650df6c8-9594-427d-9862-657ff89e9c74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050740 Jul 29 06:31:07.623074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 276/559] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:08.636035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:08.638214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:08.644916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:08.645372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:08.646136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:08.646574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:08.675539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a7023932-50f5-42b9-aa66-a0808773f5c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043363 Jul 29 06:31:08.676022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 284/560] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:09.688274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:09.690439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:09.697145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:09.697606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:09.698550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:09.699645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:09.729086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5224a256-b307-40e5-bb09-b2c636dea49f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044824 Jul 29 06:31:09.729649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 277/561] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:10.741625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:10.743786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:10.751239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:10.751688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:10.752449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:10.752917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:10.780816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8d77a6a0-df1e-4d3b-afc2-195b0bb7d423 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043138 Jul 29 06:31:10.781364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 285/562] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:11.793204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:11.795299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:11.801697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:11.802144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:11.802901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:11.803332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:11.831790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ce74fbd-a5e4-4fde-bc5f-8ab2e362143c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042677 Jul 29 06:31:11.832593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 278/563] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:12.844603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:12.846750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:12.853231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:12.853684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:12.854458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:12.854897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:12.884988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2953565f-bb34-4e74-9369-59244fe1d1ab tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044312 Jul 29 06:31:12.885551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 286/564] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:12.887051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:12.889183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:12.895561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:12.896004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:12.896787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:12.897222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:12.924660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-538dd39a-d9fd-4491-b7e0-05d9fc5022f1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042031 Jul 29 06:31:12.925209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 279/565] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:31:12 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 06:31:12.987169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:12.987665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:12.993679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:12.994137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:12.994899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:12.995343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:13.020613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:31:13.093886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f9446bd2-0d89-4d6c-9dc3-d8fd1af6efa0 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 204 len: 0 microversion: 2.1 time: 0.110310 Jul 29 06:31:13.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 287/566] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:31:12 2022] DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:31:13.103236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:13.103866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:13.110313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:13.110758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:13.111512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:13.111942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:13.240788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:13.248208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-69446508-831e-4ad7-8790-5b8d42922a63 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.148881 Jul 29 06:31:13.248794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 280/567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:13 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:13.898765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:13.900963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:13.907488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:13.907932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:13.908711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:13.909147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:13.938672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0b7ffcb0-d475-4637-8d44-1064ed501526 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044152 Jul 29 06:31:13.939206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 288/568] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:14.269519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:14.270132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:14.276617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:14.277985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:14.278567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:14.279005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:14.410003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:14.417626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-00a97074-d58a-41ac-adbe-3d3e8163b105 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.151860 Jul 29 06:31:14.418193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 281/569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:14 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:14.951601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:14.953770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:14.960342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:14.960818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:14.961565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:14.961991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:14.990504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1e366f98-9cba-41d7-b14a-144b5de2b733 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043527 Jul 29 06:31:14.990981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 289/570] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:15.439568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:15.440216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:15.446708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:15.447154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:15.447912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:15.448355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:15.574896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:15.582549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-933776e1-039d-4307-acd9-4b82a8b9e182 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.146575 Jul 29 06:31:15.583113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 282/571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:15 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:16.002591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:16.004728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:16.011653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:16.012255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:16.013066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:16.013503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:16.041993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f11f5ec3-bad7-4459-9827-b6503dd17864 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043321 Jul 29 06:31:16.042573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 290/572] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:16.605012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:16.605609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:16.612050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:16.612503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:16.613305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:16.613746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:16.742468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:16.750553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-25faeae2-af78-4adc-b24a-857640b0691b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.149792 Jul 29 06:31:16.751346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 283/573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:16 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:17.054367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:17.056498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:17.063716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:17.064200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:17.065027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:17.065470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:17.090464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:17.095332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3795741c-0c27-4d1d-854a-8ff7124a5c00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044989 Jul 29 06:31:17.095961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 291/574] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:17.772003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:17.772639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:17.779917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:17.780369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:17.781177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:17.781606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:17.910781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:17.918709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a8ceb7e-dce0-479a-be10-56eaeba76b96 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.150519 Jul 29 06:31:17.919276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 284/575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:17 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:18.107403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:18.109582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:18.117065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:18.117513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:18.118272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:18.118710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:18.148345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5ee19ede-6e35-4b39-9e5c-e3d5e9f1d821 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044936 Jul 29 06:31:18.148933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 292/576] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:18.940104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:18.940778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:18.947268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:18.947719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:18.948489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:18.949810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:19.075796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:19.079276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:19.084390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f6c0393-7d24-4d69-8489-087b3acbd2cc tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.148153 Jul 29 06:31:19.084979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 285/577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:18 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:19.161115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:19.163296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:19.170213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:19.170660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:19.171413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:19.171845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:19.201259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-af897d77-d2cf-4cf7-83ce-b26d392ea3f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044053 Jul 29 06:31:19.201823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 293/578] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:20.106312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:20.106930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:20.114307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:20.114758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:20.115520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:20.115961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:20.213419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:20.216237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:20.222807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:20.223260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:20.224032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:20.224469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:20.249029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:20.253982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-391a2d3f-8c4f-4d98-93d6-a33a0c5d1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044474 Jul 29 06:31:20.254729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 294/579] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:20.256370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7d194ba7-59a8-4212-81f7-c6f0b3560945 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.153867 Jul 29 06:31:20.256994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 286/580] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:20 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:21.266880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:21.269174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:21.277186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:21.277644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:21.278420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:21.279276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:21.279717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:21.280350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:21.287965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:21.288423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:21.289228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:21.289666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:21.312286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-32e4f6c2-3d34-4fd7-a974-9b73dda55093 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049305 Jul 29 06:31:21.317380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 295/581] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:21.474431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:21.482369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9bbe7ea1-398e-4556-b4b8-5544463efde1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.207765 Jul 29 06:31:21.482962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 287/582] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:21 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:22.325200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:22.327322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:22.333983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:22.334440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:22.335207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:22.335648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:22.364625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-67442315-a032-42bd-b48a-5c32c1a8ae6b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043843 Jul 29 06:31:22.365271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 296/583] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:22.503890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:22.504512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:22.512124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:22.512889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:22.513751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:22.514197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:22.643755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:22.651331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-52de9462-2f85-4304-8f51-70f97ec555e7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.151177 Jul 29 06:31:22.651967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 288/584] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:22 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:23.377441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:23.379547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:23.386607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:23.387089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:23.387851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:23.388289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:23.417288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fdfc3eab-3a89-4cf3-ab83-c5674bf998be tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043737 Jul 29 06:31:23.417918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 297/585] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:23.672552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:23.673201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:23.679598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:23.680050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:23.680845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:23.681284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:23.811731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:23.819248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0eac4637-e74c-4110-bae6-52ff1ef21d8b tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.150585 Jul 29 06:31:23.819803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 289/586] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:23 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:24.431152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:24.433502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:24.442878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.443669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.444692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.445330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.482805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-905e0677-ed78-43af-9892-01b4a6a9e0d3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055505 Jul 29 06:31:24.483601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 298/587] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:24.514077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:24.516322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:24.528732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.529194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.530014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.530455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.555428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lazy-loading 'flavor' on Instance uuid e3c6cd3c-a26a-45fe-b507-9594b994002c {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:31:24.696036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-25a0cea4-5ef0-4368-8369-a7b62d392e31 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/action" status: 200 len: 32 microversion: 2.1 time: 0.186497 Jul 29 06:31:24.697125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 290/588] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:31:24 2022] POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/action => generated 32 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 06:31:24.708133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:24.709320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:24.716206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.716698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.722841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.723291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.842327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:24.843031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:24.849289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.849742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.850516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:24.850958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:24.940428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:24.950314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c494d9f-a42f-4a97-a53f-9767ae1ca840 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.246373 Jul 29 06:31:24.961323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 299/589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:25.032651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:25.041166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f5ec0110-8879-46ba-ae28-7bd5f31941d6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 200 len: 1675 microversion: 2.1 time: 0.203673 Jul 29 06:31:25.052720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 291/590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:24 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 1675 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:25.344004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-3c8ca6f6-f7a6-4920-983d-fc06255ac767 req-2336ef54-3d35-471d-b2ff-228113aa22aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0f47fa5-72de-4c83-a201-89fb8435978e", "name": "network-vif-deleted", "tag": "f24af601-0f43-41c4-bb28-56b5a48554aa"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:25.361078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3c8ca6f6-f7a6-4920-983d-fc06255ac767 req-2336ef54-3d35-471d-b2ff-228113aa22aa service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:25.361879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3c8ca6f6-f7a6-4920-983d-fc06255ac767 req-2336ef54-3d35-471d-b2ff-228113aa22aa service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:25.389232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-3c8ca6f6-f7a6-4920-983d-fc06255ac767 req-2336ef54-3d35-471d-b2ff-228113aa22aa service nova] Creating event network-vif-deleted:f24af601-0f43-41c4-bb28-56b5a48554aa for instance c0f47fa5-72de-4c83-a201-89fb8435978e on hv-cinder-83482 Jul 29 06:31:25.396840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-3c8ca6f6-f7a6-4920-983d-fc06255ac767 req-2336ef54-3d35-471d-b2ff-228113aa22aa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057306 Jul 29 06:31:25.398087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 300/591] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:25.497015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:25.499838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:25.506262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:25.506718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:25.507506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:25.507947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:25.543233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d149d3ef-5d9a-464d-9de8-c1d4bf675517 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051172 Jul 29 06:31:25.548766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 292/592] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:25.974663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:25.975370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:25.977470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:25.986086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:25.986667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:25.987896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:25.988381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:26.063990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:26.065154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:26.071537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=47 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:26.073465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:26.075534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:26.076746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:26.077348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:26.093394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] HTTP exception thrown: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Request method failure captured: Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e HTTP/1.1 Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432fxti8pbSYNfIk9o3lK909ucRXvyHrKqmpzH9oVvs2UiIFjuM9RqA0LRKHJmDJki-jYaMr1eW0A7kaPPUOrHe5w0hKPz02vAQrlHG--dcHNwUWwC56fAw_IhnWIDsRH69WhGM9qDTfRMslQNBnMWUE6fnuZ8CgyqP4ABLUZUUeC2c Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:31:26.095306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3b773b1bba540f79c21b042d5cf91de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: e1b9767f26254a6cba945f4cae562b70 Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:31:26.096924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'c0f47fa5-72de-4c83-a201-89fb8435978e'} Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:31:26.097854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:31:26.099330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:31:26.101328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Returning 404 to user: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:31:26.102335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c8640fd6-3aa1-409f-9d93-04faebb283ed tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 404 len: 111 microversion: 2.1 time: 0.042148 Jul 29 06:31:26.107428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 293/593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:26 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:31:26.112869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4914bc23-bd3c-4813-8c4c-559abc106563 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '.version_select at 0x7f1459adeb80>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:26.139236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:26.143905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4914bc23-bd3c-4813-8c4c-559abc106563 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632682904" status: 202 len: 0 microversion: 2.1 time: 0.034713 Jul 29 06:31:26.148265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 294/594] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Jul 29 06:31:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632682904 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:31:26.151572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-15d716c3-a1f5-45e4-b021-851878c1e0df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.183340 Jul 29 06:31:26.156689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 301/595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:26.555826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:26.558859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:26.566283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:26.566992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:26.567972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:26.568600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:26.601625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-042f2026-14ed-449e-8c89-a981ff296383 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049623 Jul 29 06:31:26.602361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 295/596] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:26.853938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-86ceee0e-e75b-4d9f-a6b0-7e27b88cabab tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'create', calling method: .version_select at 0x7f145923f040>, body: {"keypair": {"name": "tempest-keypair-668177473", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAgrrMtQYam0JZCKlo/JUBybXZxXmlwfeLYOlJfBc1I/fvDYw66tJk39BpFC+I7aJNn5yLmv6G9+fbBWtd7QupzDlr//t276bkaBPa1oDjGrLDF1QVasv/+p+tvT/dHaA=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:26.869626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-86ceee0e-e75b-4d9f-a6b0-7e27b88cabab tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for project a3b773b1bba540f79c21b042d5cf91de. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:31:26.874590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-86ceee0e-e75b-4d9f-a6b0-7e27b88cabab tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for user e1b9767f26254a6cba945f4cae562b70 and project a3b773b1bba540f79c21b042d5cf91de. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:31:26.899319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-86ceee0e-e75b-4d9f-a6b0-7e27b88cabab tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049511 Jul 29 06:31:26.899907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 302/597] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 06:31:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:27.174989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:27.175557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:27.183944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:27.184457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:27.185299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:27.185740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:27.520698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:27.529257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7e0b4c8e-d24d-4437-8574-03dd7c7c15b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.358221 Jul 29 06:31:27.529829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 296/598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:27.614091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:27.616464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:27.624648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:27.625321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:27.626170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:27.626612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:27.658276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-654805ff-08ea-4fef-b110-ddd1619d42dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048265 Jul 29 06:31:27.658845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 303/599] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:28.211017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-681757679", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e48f73d3-d5d1-41f9-95a6-4ab182e46c68"}], "security_groups": [{"name": "tempest-securitygroup--109636861"}], "key_name": "tempest-keypair-668177473", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:28.335498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] validate_networks() for [('e48f73d3-d5d1-41f9-95a6-4ab182e46c68', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:31:28.551496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:28.552106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:28.558322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:28.558775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:28.559527 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:28.559957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:28.718680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:31:28.719287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:31:28.719937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:31:28.720356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:31:28.720797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:31:28.729882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:28.730340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:28.731244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:28.731687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:28.748990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for project a3b773b1bba540f79c21b042d5cf91de. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:31:28.749285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:28.752986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Getting quotas for user e1b9767f26254a6cba945f4cae562b70 and project a3b773b1bba540f79c21b042d5cf91de. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:31:28.757480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-90139bfa-0425-4166-a188-2457f24271f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.210101 Jul 29 06:31:28.758039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 304/600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:28.768933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:28.769158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:31:28.769278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:28.769360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:31:28.772983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:28.773430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:28.774184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:28.774617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:28.804470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-32973063-47b2-4a79-95bc-311008ffc8f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045408 Jul 29 06:31:28.805062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 305/601] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:28.812154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [8ac80aef-0303-45bf-8f20-02f6038440ab] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 06:31:29.779842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:29.780583 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:29.787086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:29.787540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:29.788329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:29.788799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:29.819745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [8ac80aef-0303-45bf-8f20-02f6038440ab] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 37348. Jul 29 06:31:29.824587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7da7339a-6ab4-4a12-9a80-96ed9d528da9 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.618007 Jul 29 06:31:29.831015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 297/602] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:31:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 1620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:31:29.831015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:29.835611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:29.844261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:29.844749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:29.845531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:29.846223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:29.879785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1944b21a-2b5b-43ed-b660-c36920ad83cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053352 Jul 29 06:31:29.884529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 298/603] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:29.884749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0ded4c45-ed5c-48fa-92ba-a6fba0b04968 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:29.885791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0ded4c45-ed5c-48fa-92ba-a6fba0b04968 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:29.941186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:29.946192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0ded4c45-ed5c-48fa-92ba-a6fba0b04968 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:29.950824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f58c8ba1-fc0b-4ca4-b89e-4fe285fe45bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.175476 Jul 29 06:31:29.951800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 306/604] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:29.953877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0ded4c45-ed5c-48fa-92ba-a6fba0b04968 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1236 microversion: 2.1 time: 0.072509 Jul 29 06:31:29.954571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 299/605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:29 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1236 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:30.893514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:30.895712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:30.902402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:30.902893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:30.903757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:30.904205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:30.935169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c83ed33e-278a-4c3a-a26c-d6067bb7a667 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046745 Jul 29 06:31:30.935730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 307/606] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:30.974180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:30.974692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:30.974804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:30.975044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:30.981422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:30.981876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:30.982650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:30.982903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:30.983093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:30.983401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:30.984176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:30.984640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:31.048901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:31.056334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-90aa623c-c550-461e-85e4-86402e6da8b7 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1294 microversion: 2.1 time: 0.086066 Jul 29 06:31:31.057263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 308/607] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:30 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:31.187644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:31.195864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d95bc04-5a39-4f1a-aa57-bd36e32d3b18 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.225557 Jul 29 06:31:31.196434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 300/608] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:31.947789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:31.950264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:31.957068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:31.957901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:31.958739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:31.959178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:31.989542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2d560baa-4233-4fc9-a9e5-3b0848974de7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045968 Jul 29 06:31:31.990122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 309/609] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:32.078221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:32.079098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:32.086011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:32.086548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:32.087407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:32.087773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:32.216987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:32.217794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:32.223843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:32.224363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:32.225226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:32.225726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:32.229776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:32.285976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:32.295244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e44a9488-c3c2-4cf0-89e5-3a0d4f2e5a1f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.220875 Jul 29 06:31:32.296124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 301/610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:32 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:32.344003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-c9d51ef1-de5b-4636-a826-ca2aabd6d2ee req-4dd96f29-244b-4197-b42a-9fea8dfed927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1670afa-b434-47b5-a7d8-88464f5bd861", "tag": "06633a8c-27ad-4ecc-9347-65119140506f"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:32.355807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-c9d51ef1-de5b-4636-a826-ca2aabd6d2ee req-4dd96f29-244b-4197-b42a-9fea8dfed927 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:32.356255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-c9d51ef1-de5b-4636-a826-ca2aabd6d2ee req-4dd96f29-244b-4197-b42a-9fea8dfed927 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:32.367976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:32.373630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-c9d51ef1-de5b-4636-a826-ca2aabd6d2ee req-4dd96f29-244b-4197-b42a-9fea8dfed927 service nova] Creating event network-changed:06633a8c-27ad-4ecc-9347-65119140506f for instance c1670afa-b434-47b5-a7d8-88464f5bd861 on hv-cinder-83482 Jul 29 06:31:32.378748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-c9d51ef1-de5b-4636-a826-ca2aabd6d2ee req-4dd96f29-244b-4197-b42a-9fea8dfed927 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049936 Jul 29 06:31:32.379596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 302/611] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:32.383425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6aed4d88-19bf-4694-9248-d2c49316de48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.170217 Jul 29 06:31:32.384268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 310/612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:33.003440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:33.005798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:33.013097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:33.013551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:33.014413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:33.014863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:33.044021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ee87f796-948a-419f-a862-8f48a0d3fef0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044875 Jul 29 06:31:33.044586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 303/613] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:33.321268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:33.321850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:33.328885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:33.329332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:33.330095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:33.330528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:33.406212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:33.406820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:33.413467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:33.413925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:33.414691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:33.415162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:33.436080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:33.462513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:33.470061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cbfd3f8e-65c6-4b05-801e-1eeb9322c8b5 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.152750 Jul 29 06:31:33.470637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 311/614] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:33 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:33.554585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:33.563545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-69eec87e-fc1e-4116-9a8b-0cd41fb16222 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.161666 Jul 29 06:31:33.564062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 304/615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:34.057120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:34.059491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:34.065539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:34.065927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:34.066688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:34.067121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:34.097598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-78accad3-47d3-4185-a3aa-4f10e8beb1b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044798 Jul 29 06:31:34.098476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 312/616] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:34.491675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:34.492288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:34.500109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:34.500578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:34.501355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:34.501801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:34.585018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:34.585627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:34.592175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:34.592654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:34.593415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:34.593847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:34.633827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:34.642826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8b79598d-082b-467e-835b-42a611c1b24f tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.154947 Jul 29 06:31:34.643414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 305/617] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:34 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:34.730996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:34.738889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9138564a-afaa-44a6-8239-02e01af626c2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158036 Jul 29 06:31:34.739450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 313/618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:31:35.109980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:35.112197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:35.118359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:35.118806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:35.119566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:35.119998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:35.150108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c8f136c-70a4-4c5d-84b9-677346b4e7fd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044092 Jul 29 06:31:35.150665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 306/619] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:35.664612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:35.665319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:35.672642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:35.673106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:35.673882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:35.674326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:35.815740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:35.824844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9c71f22a-e4db-4c41-8cea-0cba9f110fc2 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.164256 Jul 29 06:31:35.826686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 314/620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:35 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:35.879629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:35.880253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:35.887313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:35.887775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:35.888567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:35.889002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:36.017917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:36.025828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9de84750-1f1d-493e-916d-bed6ae99d031 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.268880 Jul 29 06:31:36.026444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 307/621] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:36.163171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:36.165415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:36.171885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:36.172334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:36.173139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:36.173578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:36.203499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ff9df23f-a06a-4335-811c-779cf8e627eb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045000 Jul 29 06:31:36.204059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 315/622] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:36.847055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:36.847718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:36.854516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:36.855647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:36.856407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:36.856889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:36.985926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:36.993278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-346ba476-97a4-4efb-a653-b25813c99ce8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.150025 Jul 29 06:31:36.993840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 308/623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:36 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:37.046232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:37.046852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:37.049186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=4 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:37.054806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:37.055265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:37.056039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:37.056486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:37.190024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:37.199402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9ef6fa4c-b423-450c-ba85-1a1ccecc17c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156137 Jul 29 06:31:37.199909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 316/624] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:37.216176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:37.218478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:37.224699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:37.225288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:37.226074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:37.226519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:37.256194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e373a1ee-25f5-4e4f-af03-7eca3fa6bf45 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044665 Jul 29 06:31:37.256700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 309/625] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:37.478993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-340ce5d2-baf7-4b55-8178-b4775dee015a req-40daea30-e7b1-47b0-8059-d75986567503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1670afa-b434-47b5-a7d8-88464f5bd861", "name": "network-vif-plugged", "status": "completed", "tag": "06633a8c-27ad-4ecc-9347-65119140506f"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:37.489062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-340ce5d2-baf7-4b55-8178-b4775dee015a req-40daea30-e7b1-47b0-8059-d75986567503 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:37.489508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-340ce5d2-baf7-4b55-8178-b4775dee015a req-40daea30-e7b1-47b0-8059-d75986567503 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:37.500812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-340ce5d2-baf7-4b55-8178-b4775dee015a req-40daea30-e7b1-47b0-8059-d75986567503 service nova] Creating event network-vif-plugged:06633a8c-27ad-4ecc-9347-65119140506f for instance c1670afa-b434-47b5-a7d8-88464f5bd861 on hv-cinder-83482 Jul 29 06:31:37.505663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-340ce5d2-baf7-4b55-8178-b4775dee015a req-40daea30-e7b1-47b0-8059-d75986567503 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030822 Jul 29 06:31:37.506469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 317/626] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:38.014539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:38.015188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:38.021634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:38.022085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:38.022848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:38.023286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:38.149834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:38.157887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b4ec6846-dd94-4596-b373-9a217f599435 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.147791 Jul 29 06:31:38.158445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 310/627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:38 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:38.222450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:38.223177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:38.229337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:38.229796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:38.230603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:38.231138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:38.269510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:38.271700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:38.277920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:38.278407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:38.279192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:38.279640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:38.309293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7b906012-f118-4032-8115-cd4ad82c92b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043731 Jul 29 06:31:38.309830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 311/628] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:38.365261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:38.373902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c8449929-fefb-42d1-ac75-50e8465fc2aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156207 Jul 29 06:31:38.374472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 318/629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:39.179278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:39.179892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:39.181740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:39.188074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.188565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.189333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.189769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.319983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:39.321894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:39.324519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:39.328721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca021a5e-f3f1-416b-89e4-f1b601502e7a tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1361 microversion: 2.1 time: 0.153272 Jul 29 06:31:39.329292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 312/630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:39 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:39.330864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.331391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.332172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.332907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.362183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3959234f-9734-483c-9349-6eb7ea86a54f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044311 Jul 29 06:31:39.362737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 319/631] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:39.396167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:39.396833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:39.403608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.404055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.404841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.405280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.532829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:39.540757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7b57d20d-8f3f-43da-9af1-519ebc3794f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1715 microversion: 2.1 time: 0.148350 Jul 29 06:31:39.541350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 313/632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:39.601276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:39.601776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:39.607795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.608254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.609046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.609493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.689693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] HTTP exception thrown: Cannot 'detach_volume' instance e3c6cd3c-a26a-45fe-b507-9594b994002c while it is in vm_state rescued Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Request method failure captured: Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments/da63a72f-85cd-4992-9bbe-5a021040ec7a HTTP/1.1 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432aLpZNoxOpwzy03jMfkuifWw-eHjv1eAOVtBVJETSXTO1aHbVSf8HiqQOGd9XGEJ5u0X9ktb5_PN9hCinMSg3Jqx7H9cMj0kIca5tJ2GJ_6LXL8gEXuKhto7dIywdjwTBHUhr9qY3uTf3nn8kexXBRMtoTn9tqbT-PCc4Xh098BH4 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:31:39.691299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_872e2c13f9b346598c261de5609fdf89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: b34e3e2e2e6049428295588959ca595c Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:31:39.692866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Cannot 'detach_volume' instance e3c6cd3c-a26a-45fe-b507-9594b994002c while it is in vm_state rescued Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'server_id': 'e3c6cd3c-a26a-45fe-b507-9594b994002c', 'id': 'da63a72f-85cd-4992-9bbe-5a021040ec7a'} Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e3c6cd3c-a26a-45fe-b507-9594b994002c in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:31:39.693653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e3c6cd3c-a26a-45fe-b507-9594b994002c while it is in vm_state rescued Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e3c6cd3c-a26a-45fe-b507-9594b994002c while it is in vm_state rescued Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:31:39.695073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Returning 409 to user: Cannot 'detach_volume' instance e3c6cd3c-a26a-45fe-b507-9594b994002c while it is in vm_state rescued {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:31:39.696187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-599dfe62-e6f3-4a15-93c1-bba954ede9fa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments/da63a72f-85cd-4992-9bbe-5a021040ec7a" status: 409 len: 152 microversion: 2.1 time: 0.095400 Jul 29 06:31:39.696187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 320/633] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:31:39 2022] DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments/da63a72f-85cd-4992-9bbe-5a021040ec7a => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 06:31:39.702347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:39.702875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:39.709015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.709461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.710215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.710648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.776533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-893230d6-922c-4723-afcf-7dc80331d6f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/action" status: 202 len: 0 microversion: 2.1 time: 0.078409 Jul 29 06:31:39.777454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 314/634] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:31:39 2022] POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:31:39.785419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:39.785985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:39.793015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.793489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.794254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:39.794697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:39.926166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:39.935078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ba6ccd3f-5b0c-4080-afea-0182b818c213 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1723 microversion: 2.1 time: 0.153419 Jul 29 06:31:39.935644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 321/635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:40.348075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=8 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:40.375264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:40.378172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:40.385168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.385841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.386916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.387466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.406033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:40.406748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:40.413417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.413871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.414652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.415092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.425030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7bda81cf-7b15-47f7-9573-c55e4fcfc725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054713 Jul 29 06:31:40.425850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 322/636] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:40.637805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:40.645451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a73c85e-c3fd-4095-a09e-a1cfd978ff73 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1546 microversion: 2.1 time: 0.298266 Jul 29 06:31:40.645952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 315/637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:40 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1546 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:40.665718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:40.666212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:40.672267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.672755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.673805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.674352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.756719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d3ca6b7c-0550-460d-aa42-39dd2ca7f381 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094714 Jul 29 06:31:40.757395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 323/638] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 06:31:40 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:40.957717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:40.958265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:40.964293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.964905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:40.965688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:40.966134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:41.099116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:41.107313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-91ad207d-c10e-4acc-9f39-1b5695f6cff6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1723 microversion: 2.1 time: 0.153757 Jul 29 06:31:41.107895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 316/639] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:41.438557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:41.440897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:41.446907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:41.447435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:41.448193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:41.449327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:41.478408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a211a4d8-0525-4a91-8e21-b59a8e2269d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044261 Jul 29 06:31:41.478983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 324/640] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:41.923415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-0fdb162e-0124-4e64-918f-e62f2aa7b5b7 req-de83dc1c-3133-49bd-8c6d-f9263987dc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1670afa-b434-47b5-a7d8-88464f5bd861", "tag": "06633a8c-27ad-4ecc-9347-65119140506f"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:41.933412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0fdb162e-0124-4e64-918f-e62f2aa7b5b7 req-de83dc1c-3133-49bd-8c6d-f9263987dc60 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:41.933868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0fdb162e-0124-4e64-918f-e62f2aa7b5b7 req-de83dc1c-3133-49bd-8c6d-f9263987dc60 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:41.944753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-0fdb162e-0124-4e64-918f-e62f2aa7b5b7 req-de83dc1c-3133-49bd-8c6d-f9263987dc60 service nova] Creating event network-changed:06633a8c-27ad-4ecc-9347-65119140506f for instance c1670afa-b434-47b5-a7d8-88464f5bd861 on hv-cinder-83482 Jul 29 06:31:41.949591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-0fdb162e-0124-4e64-918f-e62f2aa7b5b7 req-de83dc1c-3133-49bd-8c6d-f9263987dc60 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029777 Jul 29 06:31:41.950179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 317/641] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:31:42.129638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:42.130280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:42.136807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:42.137264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:42.138046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:42.138485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:42.274232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:42.282756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd2d8c4a-6bc3-48c5-9c83-b62009c14dc3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1723 microversion: 2.1 time: 0.157148 Jul 29 06:31:42.283333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 325/642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:42.493522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:42.495963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:42.502493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:42.502894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:42.503870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:42.504146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:42.536557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e7fc76b-942e-4439-b710-a01a6855e2a8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048840 Jul 29 06:31:42.537156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 318/643] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:43.304499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:43.305211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:43.312327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:43.312855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:43.313589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:43.314029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:43.444975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:31:43.453017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c0fc62ea-9ab9-4a1c-82fb-7add2ba84fb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1729 microversion: 2.1 time: 0.152310 Jul 29 06:31:43.453582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 326/644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:31:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:31:43.474214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:43.474715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:43.481891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:43.482351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:43.483154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:43.483599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:43.549171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:43.551216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:43.557283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:43.558064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:43.558558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:43.559293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:43.561206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2149557a-5554-4e49-9d0f-bffc3c92c2bc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090962 Jul 29 06:31:43.562206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 319/645] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 06:31:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:43.585210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:43.590985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-97e649ca-952d-46d8-a668-a825f941fd9c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045882 Jul 29 06:31:43.591549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 327/646] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:31:44.437198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-d2552fce-f0f1-4d4c-893b-a018b0855f43 req-b5dcd019-3330-489a-82dc-57365af099e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c6cd3c-a26a-45fe-b507-9594b994002c", "tag": "0d3eecc6-30a2-46cd-95ea-608f50908f78"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:44.447781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d2552fce-f0f1-4d4c-893b-a018b0855f43 req-b5dcd019-3330-489a-82dc-57365af099e7 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:44.448319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d2552fce-f0f1-4d4c-893b-a018b0855f43 req-b5dcd019-3330-489a-82dc-57365af099e7 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:44.460842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-d2552fce-f0f1-4d4c-893b-a018b0855f43 req-b5dcd019-3330-489a-82dc-57365af099e7 service nova] Creating event network-changed:0d3eecc6-30a2-46cd-95ea-608f50908f78 for instance e3c6cd3c-a26a-45fe-b507-9594b994002c on hv-cinder-83482 Jul 29 06:31:44.466609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-d2552fce-f0f1-4d4c-893b-a018b0855f43 req-b5dcd019-3330-489a-82dc-57365af099e7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032975 Jul 29 06:31:44.467192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 320/647] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:44.603517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:44.606717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:44.613582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:44.614161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:44.615217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:44.615811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:44.647020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-484924cd-0e54-4e39-9650-596450eb50b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047342 Jul 29 06:31:44.647501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 328/648] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:45.660293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:45.662600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:45.670032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:45.670480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:45.671276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:45.671716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:45.697145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:45.702481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-334dc6b4-b9db-4f18-a335-84a52c766c90 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046521 Jul 29 06:31:45.703034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 321/649] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:46.480966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-fe13c24d-f2cd-4edf-947c-36186f753117 req-ed2d1b50-fed1-48a2-9506-08460527f8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c6cd3c-a26a-45fe-b507-9594b994002c", "tag": "0d3eecc6-30a2-46cd-95ea-608f50908f78"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:31:46.490898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-fe13c24d-f2cd-4edf-947c-36186f753117 req-ed2d1b50-fed1-48a2-9506-08460527f8c8 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:46.491344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-fe13c24d-f2cd-4edf-947c-36186f753117 req-ed2d1b50-fed1-48a2-9506-08460527f8c8 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:46.502908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-fe13c24d-f2cd-4edf-947c-36186f753117 req-ed2d1b50-fed1-48a2-9506-08460527f8c8 service nova] Creating event network-changed:0d3eecc6-30a2-46cd-95ea-608f50908f78 for instance e3c6cd3c-a26a-45fe-b507-9594b994002c on hv-cinder-83482 Jul 29 06:31:46.508016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-fe13c24d-f2cd-4edf-947c-36186f753117 req-ed2d1b50-fed1-48a2-9506-08460527f8c8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030649 Jul 29 06:31:46.508617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 329/650] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:31:46.716007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:46.718266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:46.725879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:46.726263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:46.727133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:46.727629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:46.762520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-202680ca-f79a-4653-9950-e0492b45878f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051255 Jul 29 06:31:46.763052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 322/651] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:47.776214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:47.779636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:47.785817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:47.786272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:47.787030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:47.787499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:47.818971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-460632be-8fae-4b00-ab54-3f04d282f57f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047627 Jul 29 06:31:47.819523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 330/652] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:48.832016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:48.834419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:48.841695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:48.842167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:48.842936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:48.843375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:48.872761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0eadfe03-6a6a-4a73-b657-da0d23ff0221 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044701 Jul 29 06:31:48.873301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 323/653] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:49.987585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:49.989769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:49.995896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:49.996453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:49.997828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:49.998272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:50.027068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ed921f9a-5382-44bc-b080-c9c4c12beadb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.145988 Jul 29 06:31:50.028148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 331/654] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:51.039920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:51.042062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:51.048659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:51.049108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:51.049875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:51.050314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:51.079735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-077dcf7b-118b-483f-be03-65e2ecb3f90c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044045 Jul 29 06:31:51.080278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 324/655] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:52.093209 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:52.095348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:52.101819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:52.102276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:52.103034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:52.103472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:52.131851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ce61089a-7083-4e5c-9d26-e11033c698ca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043447 Jul 29 06:31:52.132404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 332/656] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:53.144184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:53.146278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:53.153043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:53.153266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:53.154022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:53.154455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:53.182522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-055cacf1-789f-4825-ba6e-0f0b245a325c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042440 Jul 29 06:31:53.183065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 325/657] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:54.194677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:54.196881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:54.203782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:54.204238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:54.205041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:54.205483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:54.234787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ceb6eced-be7e-4e2a-a499-147c1694b2c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Jul 29 06:31:54.235340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 333/658] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:55.247465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:55.249630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:55.256125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:55.256622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:55.257390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:55.257834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:55.287262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cdec6fb9-3659-4b01-8aa2-baaaedde6492 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044000 Jul 29 06:31:55.287816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 326/659] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:56.300098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:56.302292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:56.304716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:56.310019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:56.310470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:56.311230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:56.311664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:56.341037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e2cf7024-39b7-49cd-87e9-aa7898c51684 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044800 Jul 29 06:31:56.341582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 334/660] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:57.353750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:57.356451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:57.358786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:31:57.364146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:57.364641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:57.365417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:57.365884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:57.395564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9865c682-f7fd-45d0-bb7d-8e37f4335007 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045969 Jul 29 06:31:57.396114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 327/661] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:58.408117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:58.410329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:58.417389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:58.417987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:58.418851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:58.419239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:58.455161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-72d5ab2a-15db-4176-92f0-052ec2344444 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051031 Jul 29 06:31:58.455737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 335/662] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:31:59.468043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:31:59.470786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:31:59.477286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:59.477738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:59.478503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:31:59.478941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:31:59.508795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d17bda04-7c56-4bbf-9b7a-2cd6a5cdbd3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044825 Jul 29 06:31:59.509351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 328/663] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:31:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:00.521508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:00.523613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:00.530998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:00.531446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:00.532197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:00.532663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:00.565070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e3d3d037-b14b-4da3-b04e-46cf35f8ffd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047500 Jul 29 06:32:00.565654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 336/664] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:01.577908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:01.580091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:01.586877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:01.587329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:01.588098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:01.588560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:01.617062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a3e9d9d-c119-41ab-8a1e-84d18311ab4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043751 Jul 29 06:32:01.617612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 329/665] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:02.629133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:02.631342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:02.638406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:02.638853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:02.639611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:02.640045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:02.670882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-96d76857-bf7e-405f-a2c8-a7aa7203b6b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045670 Jul 29 06:32:02.671433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 337/666] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:03.683117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:03.685793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:03.692198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:03.692675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:03.693427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:03.693857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:03.723462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-afaa282c-ce79-40e1-bf43-05754375c8d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044229 Jul 29 06:32:03.724010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 330/667] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:04.735535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:04.737798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:04.748215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:04.748705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:04.749466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:04.749901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:04.777844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b1c3692-9ecd-4b34-8a41-9dd5aac1a59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046277 Jul 29 06:32:04.778386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 338/668] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:05.789485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:05.791604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:05.798210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:05.798660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:05.799411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:05.799842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:05.829303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d21adea-c40f-4b2f-b080-3bb53d199859 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043701 Jul 29 06:32:05.829874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 331/669] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:06.842714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:06.844859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:06.851232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:06.851724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:06.852476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:06.852933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:06.881888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-42f166ea-1c4e-4d11-b963-716fec774e44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043792 Jul 29 06:32:06.882432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 339/670] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:07.893736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:07.895859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:07.903127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:07.903468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:07.904232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:07.904699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:07.932959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ff0ae850-93be-4c41-852c-3241a84a83f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043123 Jul 29 06:32:07.933707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 332/671] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:08.945919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:08.948071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:08.956051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:08.956514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:08.958807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:08.958807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:08.988225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ecd211ad-b00c-42c9-b5a6-db05f18022a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046340 Jul 29 06:32:08.988734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 340/672] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:10.001416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:10.003485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:10.010008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:10.010462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:10.011238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:10.011678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:10.042122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-70ed61e5-a7c8-4122-b9f5-ce4bbb1bac5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044693 Jul 29 06:32:10.043305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 333/673] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:11.055241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:11.057318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:11.064288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:11.064774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:11.065529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:11.065962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:11.095511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f7a041c4-bed3-4140-b955-2f5a4bce7896 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044325 Jul 29 06:32:11.096063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 341/674] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:12.108374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:12.110565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:12.117119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:12.117573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:12.118340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:12.118779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:12.150416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1986a1e6-9c94-4aaa-b2f8-7ca4c5892b93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046496 Jul 29 06:32:12.150968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 334/675] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:13.163471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:13.165642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:13.172660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:13.173107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:13.173856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:13.174287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:13.202806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d7f6c6c-ad6d-45b6-97a9-e9a78cf84eb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043252 Jul 29 06:32:13.203349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 342/676] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:14.216020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:14.218227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:14.224719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:14.225169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:14.225926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:14.226358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:14.255657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3b9e8619-79c0-4d1a-8d95-7c7676e76f21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044276 Jul 29 06:32:14.256206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 335/677] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:15.267668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:15.269890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:15.276409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:15.276889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:15.277754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:15.278187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:15.280489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=87 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:15.307370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4a328e68-ba5e-49f1-b1ce-481c83f7f00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043755 Jul 29 06:32:15.308496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 343/678] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:16.320349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:16.322518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:16.329482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:16.329927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:16.330681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:16.331110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:16.359532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0d36a0ed-aacc-4f38-89c3-16724cdc0fd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043186 Jul 29 06:32:16.360075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 336/679] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:16.700524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:16.701075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:16.707795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:16.708249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:16.709043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:16.709485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:16.791068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lazy-loading 'services' on Instance uuid e3c6cd3c-a26a-45fe-b507-9594b994002c {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:32:16.861683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f11a313b-170d-47b0-b0d0-c8d62b1b1b8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments/da63a72f-85cd-4992-9bbe-5a021040ec7a" status: 202 len: 0 microversion: 2.1 time: 0.164621 Jul 29 06:32:16.862410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 344/680] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:32:16 2022] DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments/da63a72f-85cd-4992-9bbe-5a021040ec7a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:32:16.873686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:16.876119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:16.882845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:16.883353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:16.884278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:16.884760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:16.888851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=91 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:16.917949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5fdb56b2-59b9-42d2-8544-85c891eda61e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048944 Jul 29 06:32:16.918504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 337/681] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:17.372373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:17.374637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:17.380837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:17.381289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:17.382160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:17.382483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:17.411612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d061fba8-317b-40ae-b79a-e030bd1e9010 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044016 Jul 29 06:32:17.412157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 345/682] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:17.828893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:17.829417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:17.836045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:17.836494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:17.837282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:17.837715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:17.860567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4f3ffda1-f416-4c22-b95e-5bfa519edbdb tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861/ips" status: 200 len: 145 microversion: 2.1 time: 0.035532 Jul 29 06:32:17.861124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 338/683] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:32:17 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:17.931279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:17.934011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:17.940057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:17.940511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:17.941302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:17.941833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:17.971938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3ffb3839-ea73-4edb-a47b-be71545bd8bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Jul 29 06:32:17.972605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 346/684] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:18.423772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:18.425962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:18.431868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.432317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.433135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.433567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.462267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10035ff4-fcd7-4396-aa8c-bbf5f6889029 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042646 Jul 29 06:32:18.462809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 339/685] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:18.772965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:32:18.773500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:18.779526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.779969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.780746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.781179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.802971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lazy-loading 'flavor' on Instance uuid 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:32:18.878320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0211e43d-af6a-44bf-aa67-92cdb33df276 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "POST /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732/action" status: 202 len: 0 microversion: 2.1 time: 0.109105 Jul 29 06:32:18.879019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 347/686] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:32:18 2022] POST /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:32:18.888643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:18.889377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:18.896962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.897422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.898312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.898866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.985008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:18.987292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:18.994130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.994590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:18.996040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:18.996487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:19.026313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b1cfd754-5a4d-4254-9024-89ea14183458 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046467 Jul 29 06:32:19.027067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 348/687] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:19.040417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:19.048361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-94c9c017-136b-4b81-865d-0116d8d37567 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.164546 Jul 29 06:32:19.048940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 340/688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:19.475619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:19.477865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:19.483861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:19.484301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:19.485105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:19.485515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:19.514821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a78aceb9-ab85-4296-89fc-2edc61b1cd5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043346 Jul 29 06:32:19.515375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 349/689] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:20.039155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:20.041313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:20.048601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:20.049063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:20.049831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:20.050272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:20.069398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:20.070341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:20.076963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:20.077438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:20.078214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:20.078652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:20.079143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b99aa536-2dd8-4ce0-be63-76221e40be42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044030 Jul 29 06:32:20.079712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 341/690] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:20.211961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:20.220284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-87b1c41c-dcbf-4111-9d5d-de3ee226642e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154535 Jul 29 06:32:20.220888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 350/691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:32:20.528405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:20.530632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:20.536676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:20.537134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:20.537900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:20.538344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:20.567481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f50b3a05-5153-473d-8884-3728c79ca68b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Jul 29 06:32:20.568025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 342/692] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:21.091783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:21.094033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:21.100811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:21.101268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:21.102025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:21.102470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:21.131075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aae91bdf-1092-4f2e-98d9-da18ddced4a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043256 Jul 29 06:32:21.131611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 351/693] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:21.242210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:21.242938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:21.249678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:21.250144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:21.250911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:21.251353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:21.379710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:21.387466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1bc4d211-af6c-47ae-a0ae-f838eaa90717 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149270 Jul 29 06:32:21.388027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 343/694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:21.579555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:21.581783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:21.587910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:21.588362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:21.589997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:21.590447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:21.619547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f5f7ebcd-9981-478e-acd6-e60e8ccdf393 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043990 Jul 29 06:32:21.620023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 352/695] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:22.143430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:22.145596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:22.151649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:22.152244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:22.153033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:22.153468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:22.184098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e5fd940b-a3e1-4231-ba56-f7d2929a764d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 Jul 29 06:32:22.184873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 344/696] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:22.408211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:22.408781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:22.415153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:22.415600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:22.416359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:22.416809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:22.544640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:22.552081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-79874c7c-74a9-4c63-a898-dda1b269b82e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147778 Jul 29 06:32:22.552665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 353/697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:22.632060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:22.634200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:22.641213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:22.641661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:22.642420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:22.642852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:22.671949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85a3c801-8dee-43e7-94a0-f009039324de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044043 Jul 29 06:32:22.672418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 345/698] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:32:23.195336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:23.197489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:23.204034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:23.204483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:23.205270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:23.205702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:23.236723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a4b33a13-13df-44f1-bb74-fd79297d18f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045249 Jul 29 06:32:23.237278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 354/699] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:23.573626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:23.574158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:23.580115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:23.580592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:23.581362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:23.581798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:23.685023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:23.687180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:23.693134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:23.693592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:23.694369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:23.694812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:23.710324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:23.718024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef33d009-b264-44f0-9cee-975e3f0a926a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148276 Jul 29 06:32:23.718589 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 346/700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:23.726455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9383a13a-2ad7-460b-a73a-c35f11d65e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046166 Jul 29 06:32:23.731843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 355/701] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:32:24.249292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:24.251577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:24.257916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:24.258364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:24.259137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:24.259569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:24.291062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1eca19e0-c437-4637-a4a2-e57a12a3b470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Jul 29 06:32:24.291629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 347/702] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:24.739530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:24.740459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:24.741099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:24.741688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:24.748188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:24.748639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:24.748767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:24.749098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:24.749431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:24.749869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:24.750006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:24.750306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:24.779258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b38e9c3e-432e-4540-bb66-ae897177b85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043665 Jul 29 06:32:24.780026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 356/703] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:24.881473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:24.889514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-355daf97-7f89-4794-8e2c-41e932078915 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152779 Jul 29 06:32:24.890079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 348/704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:32:25.303652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:25.305826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:25.312224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:25.312704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:25.313464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:25.313903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:25.316310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:25.346402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d766ed09-c98f-4d54-a427-c3d3e27278f3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046618 Jul 29 06:32:25.346979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 357/705] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:25.791800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:25.794626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:25.801157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:25.801615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:25.802382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:25.802821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:25.831535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aa7593a9-c0bc-43c5-b0c8-77cae52e6250 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043801 Jul 29 06:32:25.832337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 349/706] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:25.910281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:25.910919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:25.917378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:25.917823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:25.919027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:25.919486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:26.047488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:26.054819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9144f749-5207-40db-9a86-7a4879463593 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148343 Jul 29 06:32:26.055402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 358/707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:26.358515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:26.360765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:26.366755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:26.367209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:26.367978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:26.368420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:26.397169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3edd598b-0406-4fdd-8439-fd5d4240e316 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043333 Jul 29 06:32:26.397716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 350/708] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:26.843638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:26.845975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:26.847808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=50 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:26.853174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:26.853618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:26.854375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:26.854804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:26.883727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-82420f00-4f91-47e0-b837-376852868b9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044278 Jul 29 06:32:26.884275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 359/709] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:27.076859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:27.077402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:27.084167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:27.084653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:27.085426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:27.085871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:27.214321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:27.221816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c6704856-7a20-41a7-8efb-ca75f6f843e6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149520 Jul 29 06:32:27.222380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 351/710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:27.409396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:27.411525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:27.417919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:27.418367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:27.419954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:27.420391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:27.448571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0d20e8c3-7d54-427d-8d11-0eb614dcc33b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043073 Jul 29 06:32:27.449114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 360/711] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:27.896642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:27.898776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:27.900644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=50 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:27.906420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:27.906866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:27.907633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:27.908071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:27.938893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c6aca759-77de-4f59-b41a-368478e19c43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046206 Jul 29 06:32:27.939436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 352/712] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:28.243814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:28.244356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:28.251009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:28.251467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:28.252224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:28.252689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:28.379359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:28.386784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2b252ccb-389f-4205-9f8c-30e6720814cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147538 Jul 29 06:32:28.387339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 361/713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:28.461749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:28.463933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:28.471065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:28.471515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:28.472284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:28.472751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:28.503223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2cdd25b9-b89a-4918-bb70-8242b83d3f54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045562 Jul 29 06:32:28.504018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 353/714] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:28.951766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:28.953994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:28.961512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:28.961708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:28.962384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:28.962821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:28.992443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7df63ba3-5f8f-44a4-9444-3c637051f970 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045032 Jul 29 06:32:28.993044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 362/715] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:29.408011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:29.408774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:29.414831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:29.415357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:29.416134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:29.416597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:29.420823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:29.516067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:29.518854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:29.524954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:29.525403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:29.526177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:29.526608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:29.557075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-85674d2c-21a6-42ec-90e4-a9a778b455fd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045640 Jul 29 06:32:29.557643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 363/716] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:32:29.619459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:29.627514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f12ca2e2-48aa-4bd7-8ddf-973c17f17055 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.223581 Jul 29 06:32:29.628074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 354/717] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:30.005333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:30.007487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:30.014223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:30.014665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:30.015599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:30.016037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:30.045300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e0dfeddb-6f56-4e63-9d22-e0626ad70dbd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043931 Jul 29 06:32:30.045838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 364/718] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:30.569115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:30.571261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:30.578578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:30.579021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:30.579775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:30.580208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:30.608518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ff8ed85a-8a7f-4c40-aef8-ad73a427c5ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043328 Jul 29 06:32:30.609072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 355/719] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:30.648045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:30.648683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:30.654816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:30.655261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:30.656009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:30.656442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:30.788890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:30.796998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-762cd6c8-c00f-49f1-984f-bdc0a759a7ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152711 Jul 29 06:32:30.797556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 365/720] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:31.057665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:31.060408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:31.066747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:31.067277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:31.068056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:31.068495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:31.097922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7c44da7d-1863-4663-abd7-b852007fab00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Jul 29 06:32:31.098478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 356/721] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:31.620723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:31.622834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:31.629652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:31.630101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:31.630852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:31.631280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:31.662343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-df21d661-a4e3-40a0-9aaa-dd32b55d1c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045633 Jul 29 06:32:31.662895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 366/722] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:31.818186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:31.818809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:31.825767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:31.826216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:31.826978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:31.827415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:31.954527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:31.962146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7dd62f0f-7760-49be-a9e9-8335d9f89f67 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147794 Jul 29 06:32:31.962707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 357/723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:32.110552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:32.112703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:32.118716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:32.119169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:32.119928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:32.120369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:32.149512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-deaa1363-61ff-4b5a-b7d2-04695ec5575e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042914 Jul 29 06:32:32.150055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 367/724] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:32.675326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:32.677509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:32.683551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:32.684631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:32.685393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:32.685825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:32.714181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f027534c-65e4-4f16-9d32-f974c73c3d6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042862 Jul 29 06:32:32.714725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 358/725] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:32.984721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:32.985335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:32.991759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:32.992210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:32.993023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:32.993464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:33.121613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:33.129133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b87bdcad-9580-44c0-997e-88e7a4bc485b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149198 Jul 29 06:32:33.129720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 368/726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:33.161787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:33.163906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:33.170381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:33.170827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:33.171582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:33.172020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:33.200435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a0ae4dff-7f62-4a3a-ae61-621047d8d4dc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042019 Jul 29 06:32:33.201010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 359/727] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:33.726886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:33.729074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:33.735264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:33.735725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:33.736468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:33.736926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:33.767470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-91d7d53e-6b1f-4d12-a2ec-2c37496fcb28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044640 Jul 29 06:32:33.768011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 369/728] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:34.150416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:34.151033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:34.157190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:34.157637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:34.158400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:34.158836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:34.212270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:34.214457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:34.221315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:34.221772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:34.222535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:34.222971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:34.255041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a3648cae-c768-4eff-842f-d76faa02ecc6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046671 Jul 29 06:32:34.255606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 370/729] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:34.292339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:34.300369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-28a2935d-a75d-4e5f-9474-95e6e5e11da2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153762 Jul 29 06:32:34.300956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 360/730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:34.780601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:34.782723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:34.788788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:34.789239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:34.790001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:34.790437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:34.818429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-64ae2742-d249-408e-8184-8c7b34952bef tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jul 29 06:32:34.818991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 371/731] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:35.267516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:35.269750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:35.276245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.276734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.278031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.278551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.307484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-635ecbe4-f47c-4162-92d3-38cc281af3b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043977 Jul 29 06:32:35.308034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 361/732] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:35.321695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:35.322340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:35.329047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.329487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.330235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.330665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.462202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:35.470341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1e758d30-218b-4dbd-8126-315a5e84bec7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152536 Jul 29 06:32:35.470898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 372/733] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:35.789229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-2087550d-1890-4c74-8634-5e9bc6884b01 req-d88b2c1b-350d-4d7a-b803-846061698457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edc82ad-0d5b-4b12-b5fa-e69548ffd732", "name": "network-vif-unplugged", "status": "completed", "tag": "7771fb54-6e8f-4267-8251-b0e5ae9ed6bb"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:32:35.800798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-2087550d-1890-4c74-8634-5e9bc6884b01 req-d88b2c1b-350d-4d7a-b803-846061698457 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.801244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-2087550d-1890-4c74-8634-5e9bc6884b01 req-d88b2c1b-350d-4d7a-b803-846061698457 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.813179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-2087550d-1890-4c74-8634-5e9bc6884b01 req-d88b2c1b-350d-4d7a-b803-846061698457 service nova] Creating event network-vif-unplugged:7771fb54-6e8f-4267-8251-b0e5ae9ed6bb for instance 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 on hv-cinder-83482 Jul 29 06:32:35.818079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-2087550d-1890-4c74-8634-5e9bc6884b01 req-d88b2c1b-350d-4d7a-b803-846061698457 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091727 Jul 29 06:32:35.818818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 362/734] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:32:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:35.830584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:35.833047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:35.838998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.839452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.840782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:35.841418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:35.866516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:35.871612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7a121bea-43dd-4b35-b10f-7a03b70b1c94 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Jul 29 06:32:35.872170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 373/735] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:36.320522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:36.322910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:36.329622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:36.330074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:36.330840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:36.331283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:36.362684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bcbeed67-ae25-42aa-bedb-434ffaf54a6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046975 Jul 29 06:32:36.363503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 363/736] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:36.491446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:36.492050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:36.499063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:36.499508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:36.500274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:36.500745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:36.632866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:36.640793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-81f5bf89-df05-4283-a2b0-ea22f7c8dcf1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153373 Jul 29 06:32:36.641354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 374/737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:36.883326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:36.885528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:36.891975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:36.892428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:36.893246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:36.893685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:36.922200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-57372aa5-e195-4e75-8ae2-72bc91e83c7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042901 Jul 29 06:32:36.922746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 364/738] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:37.376189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:37.378354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:37.384268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:37.384747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:37.385503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:37.385934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:37.415783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5c9c073a-01b6-4ee9-a53b-c755be03d62d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044461 Jul 29 06:32:37.416331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 375/739] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:37.662524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:37.663136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:37.670684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:37.671137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:37.671897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:37.672338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:37.802536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:37.811368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87398e4d-5967-4a76-a783-5134c7262206 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152659 Jul 29 06:32:37.811930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 365/740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:37.935489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:37.937689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:37.944702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:37.945160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:37.946016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:37.946474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:37.975949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-585ca0df-6a93-4c3f-9d73-cde7881a04b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045312 Jul 29 06:32:37.976497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 376/741] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:38.427896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:38.430078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:38.436742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:38.437187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:38.437946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:38.438374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:38.466814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d91f6c9-4a90-44c0-aaeb-4d6e734838ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042989 Jul 29 06:32:38.467357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 366/742] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:38.832815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:38.833451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:38.839344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:38.840331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:38.841213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:38.841677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:38.967643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:38.975077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c8b7530b-5afc-4fc4-9cd6-062955d1f2ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146412 Jul 29 06:32:38.975641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 377/743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:38.988007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:38.990139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:38.996811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:38.997265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:38.998040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:38.998480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:39.027020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-80fd4b46-053b-4747-8b2d-6adb3d9503b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jul 29 06:32:39.028305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 367/744] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:39.479349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:39.481551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:39.487577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:39.488031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:39.488836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:39.489279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:39.518898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-317a6249-388f-46a4-b050-84fc0d6fbfcc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043571 Jul 29 06:32:39.519456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 378/745] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:39.997558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:39.998095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:40.004511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:40.004992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:40.005753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:40.006189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:40.039358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:40.041679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:40.049059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:40.049514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:40.050297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:40.050743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:40.080728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-af1733aa-3a00-46d9-9ea8-31371eff2bc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045204 Jul 29 06:32:40.081300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 379/746] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:32:40.137684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:40.145429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8127155f-0ea0-4c78-8470-8c33796a44ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152368 Jul 29 06:32:40.146000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 368/747] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:40.532188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:40.534370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:40.540340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:40.540831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:40.541620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:40.542055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:40.571856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-28b88823-36aa-4f21-bf72-b0900490de93 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044584 Jul 29 06:32:40.572402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 380/748] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:41.093775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:41.095915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:41.102390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:41.102837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:41.103590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:41.104024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:41.132956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2533c464-44b7-4af7-a791-d35443000491 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Jul 29 06:32:41.133678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 369/749] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:41.165972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:41.166575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:41.173513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:41.173959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:41.174709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:41.175137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:41.306265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:41.313973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4bd70e8d-fe3b-4a2c-abd3-e61748591331 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151737 Jul 29 06:32:41.314536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 381/750] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:41.585320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:41.587573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:41.594153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:41.594602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:41.595367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:41.595806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:41.623724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c6a2726-61a1-4d07-81e0-c1fea8e4a097 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042546 Jul 29 06:32:41.624354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 370/751] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:42.145857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:42.147990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:42.154081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:42.154537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:42.155305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:42.155746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:42.184981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ff2dd2f7-92ae-47d3-85d2-566e2d627c1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 Jul 29 06:32:42.185621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 382/752] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:42.335711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:42.336332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:42.342882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:42.343569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:42.344402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:42.344862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:42.359984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:42.474434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:42.482041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f356b9c1-99a3-4010-a89f-4673a58b1bc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150742 Jul 29 06:32:42.482637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 371/753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:42.635848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:42.638599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:42.644723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:42.645172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:42.645961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:42.646392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:42.674641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-def82127-1ba0-492f-8a82-4cfb3b51aaaf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042748 Jul 29 06:32:42.675117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 383/754] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:43.197226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:43.200240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:43.206423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:43.206873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:43.207893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:43.208362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:43.239412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-268905d9-42dd-42f5-82b2-5cd16cdf84f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046146 Jul 29 06:32:43.239962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 372/755] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:43.503059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:43.503603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:43.510028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:43.510476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:43.511235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:43.512301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:43.643514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:43.651037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a9c2f80c-8c55-4fa9-b86d-aeb3ba8d0c23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151834 Jul 29 06:32:43.651595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 384/756] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:43.687476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:43.689723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:43.696167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:43.696654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:43.697417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:43.697852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:43.727228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fabe4c72-0c3e-4707-90cd-ad0613bc710b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Jul 29 06:32:43.727791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 373/757] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:44.252118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:44.254378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:44.260417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:44.260902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:44.261725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:44.262171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:44.291718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3e1f4b9c-885d-4d7e-b508-26552821a2d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Jul 29 06:32:44.292266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 385/758] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:44.672483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:44.673117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:44.679156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:44.679584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:44.680336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:44.680797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:44.740093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:44.742806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:44.750001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:44.750451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:44.751206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:44.751636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:44.781514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca74ea90-e4c1-4edf-81ec-d41a2a784fec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045460 Jul 29 06:32:44.782339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 386/759] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:32:44.811355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:44.818775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c4bfe58-f255-4abe-9751-6371c9cc004e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150882 Jul 29 06:32:44.819361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 374/760] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:45.305022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:45.307186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:45.313837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:45.314288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:45.315053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:45.315490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:45.343542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-418bfc71-1687-4f4e-9c57-e6af6278e34a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042597 Jul 29 06:32:45.344170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 387/761] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:45.795371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:45.797783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:45.804250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:45.804737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:45.805496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:45.805926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:45.834043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-656aa3db-0ee9-4d37-8a45-6f59925dd52b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044156 Jul 29 06:32:45.836708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 375/762] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:45.841212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:45.841826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:45.848263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:45.848753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:45.849518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:45.849954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:45.981314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:45.988748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7a214e67-6974-4627-9665-8d669b97c23e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151808 Jul 29 06:32:45.989241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 388/763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:46.355840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:46.358033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:46.364014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:46.364496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:46.365302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:46.365741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:46.394838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d11d88f7-1e54-4df3-8807-0bedd5a6de60 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 Jul 29 06:32:46.395381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 376/764] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:46.846958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:46.849107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:46.855516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:46.855964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:46.856758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:46.857188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:46.885034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2fe794a9-e0f8-4940-a01b-2c19c96f79c9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042000 Jul 29 06:32:46.885578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 389/765] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:47.008882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:47.009425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:47.016689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:47.017185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:47.017960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:47.018415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:47.151307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:47.158780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b582bfc-d81b-49e3-9fcd-fb47de1f871a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153926 Jul 29 06:32:47.159344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 377/766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:47.407142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:47.409295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:47.415215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:47.415668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:47.416419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:47.416877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:47.430745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:47.446675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd2fedda-6155-417f-8e5d-7cd49ff1cb72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Jul 29 06:32:47.447217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 390/767] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:47.898105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:47.900236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:47.906649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:47.907096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:47.907852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:47.908284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:47.936617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-15772d6b-8645-433c-a463-24c2e4c18f1c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042525 Jul 29 06:32:47.937151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 378/768] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:48.179731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:48.180352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:48.187568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:48.188023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:48.188811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:48.189253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:48.317056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:48.324432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1f5df275-4697-48b8-96cc-9ec8978bbc47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148548 Jul 29 06:32:48.325007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 391/769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:48.458882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:48.460992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:48.467524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:48.467987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:48.468760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:48.469196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:48.498521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e1c3556b-cb40-414b-a60b-4ca14ba55455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Jul 29 06:32:48.499120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 379/770] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:48.949032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:48.951674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:48.957969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:48.958424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:48.959191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:48.959632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:48.988711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7d19139f-cc1d-4aed-9b7d-6bee31413ade tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043649 Jul 29 06:32:48.989190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 392/771] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:49.345814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:49.346421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:49.352628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:49.353073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:49.353840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:49.354581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:49.491803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:49.499428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-36fed870-ee97-4e38-af28-b368e40e0202 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157465 Jul 29 06:32:49.499986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 380/772] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:32:49.511031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:49.513365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:49.520105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:49.520586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:49.521367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:49.521837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:49.551919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-69a64a15-21b1-432b-bc39-8558c29ff59e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044967 Jul 29 06:32:49.552477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 393/773] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:50.001810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:50.003866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:50.009854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:50.010302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:50.011055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:50.011516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:50.040407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-95a77424-ee65-40a4-8c0e-68448c97fbd8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042681 Jul 29 06:32:50.040975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 381/774] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:50.521130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:50.521788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:50.528432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:50.528915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:50.529671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:50.530106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:50.565651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:50.567791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:50.574701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:50.575143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:50.575916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:50.576349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:50.606861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1ef0451-1e8b-47ea-9dc1-3ca4539ba04f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045136 Jul 29 06:32:50.607422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 382/775] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:32:50.662826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:50.670267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c83756b-f31b-4b00-b506-33a66a7a5da9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153587 Jul 29 06:32:50.670815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 394/776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:51.052972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:51.055158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:51.061952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:51.062407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:51.063177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:51.063623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:51.092853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b88cd0e3-7b6b-4339-8d79-1b3435a5b8e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044011 Jul 29 06:32:51.093398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 383/777] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:51.618573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:51.620658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:51.627753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:51.628196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:51.628983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:51.629415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:51.657842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6ba40906-8da2-44e4-aab8-1c958cb23c52 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 Jul 29 06:32:51.658377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 395/778] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:51.691475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:51.692080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:51.698164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:51.698609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:51.699363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:51.700406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:51.830430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:51.838092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2e3cce83-b7df-446f-bf05-6991c29a16fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150463 Jul 29 06:32:51.838646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 384/779] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:52.105174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:52.107851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:52.113877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:52.114326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:52.115089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:52.115505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:52.144041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9f51d716-deea-48d0-a24a-e47c911b25c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042779 Jul 29 06:32:52.144591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 396/780] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:52.669858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:52.672021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:52.678411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:52.678856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:52.679612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:52.680046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:52.709275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6a9926e0-93b5-423f-87fb-c96cd28b413d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043404 Jul 29 06:32:52.709928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 385/781] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:52.859390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:52.859997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:52.866469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:52.866913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:52.867664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:52.868104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:53.001160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:53.008588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-239efecc-e1b1-4d05-99db-fef871425407 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153544 Jul 29 06:32:53.009191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 397/782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:53.156272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:53.158432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:53.164381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:53.164859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:53.165614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:53.166047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:53.194348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c54ac966-caba-4fa9-95cd-ec111882b1e1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042962 Jul 29 06:32:53.194891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 386/783] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:53.722190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:53.724236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:53.730450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:53.731010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:53.731891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:53.732871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:53.760867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-269f3378-aeda-437a-863d-94fc693d15d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042684 Jul 29 06:32:53.761413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 398/784] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:54.035800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:54.036327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:54.043916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:54.044567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:54.045336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:54.045769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:54.172613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:54.179996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-41fe9f84-f1b6-4109-908a-055f25a8e3a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148105 Jul 29 06:32:54.180573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 387/785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:54.206610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:54.209072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:54.216077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:54.216447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:54.217269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:54.217715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:54.245862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5783a441-03f4-40ef-b97e-239256727d14 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043213 Jul 29 06:32:54.246520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 399/786] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:54.774050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:54.776175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:54.782477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:54.782924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:54.783674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:54.784106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:54.786442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:54.813715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fde766e8-ab73-4b2b-9709-d4bd9d1bce4b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Jul 29 06:32:54.814379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 388/787] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:55.201610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:55.202236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:55.209044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:55.209620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:55.210248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:55.210680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:55.258404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:55.260659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:55.268479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:55.269033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:55.269875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:55.270383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:55.299913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-11e93052-116e-4de6-97bf-3c22a48f529f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Jul 29 06:32:55.300485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 389/788] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:32:55.339788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:55.347410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b135df4b-6f36-4e92-9be2-355c985ad8d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150289 Jul 29 06:32:55.347976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 400/789] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:55.825398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:55.827514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:55.833755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:55.834204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:55.834958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:55.835391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:55.863874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-55e9cc81-431b-47b4-8f1b-01859f29dfb8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042616 Jul 29 06:32:55.864625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 390/790] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:56.312994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:56.315195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:56.321638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:56.322083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:56.322845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:56.323279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:56.352429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fd1397f5-c217-48f4-8dca-4695e2d151a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044116 Jul 29 06:32:56.353009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 401/791] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:56.368104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:56.368769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:56.375487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:56.375936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:56.376744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:56.377185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:56.508985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:56.516938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a05a52ab-76cb-4e2a-bd17-c630e018d057 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152554 Jul 29 06:32:56.517501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 391/792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:56.875493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:56.877645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:56.879473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=86 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:56.884774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:56.885225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:56.885979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:56.886414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:56.915167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9b6d7961-0d81-4d23-8a7e-d90542a318cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Jul 29 06:32:56.915710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 402/793] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:57.365828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:57.368012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:57.374368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:57.374868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:57.375587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:57.376028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:57.406673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f1035319-11b1-4611-93f0-1cc89d1c68a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044836 Jul 29 06:32:57.407232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 392/794] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:57.538493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:57.539103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:57.545936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:57.546394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:57.547156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:57.547594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:57.678580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:57.686478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2ebcd179-87d1-4c66-bfdf-3cbc2a4d0c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151836 Jul 29 06:32:57.687041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 403/795] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:57.927534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:57.930740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:57.932620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=82 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:32:57.938489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:57.938947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:57.939723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:57.940168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:57.969901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f886be71-db7a-4698-9b6a-dc66f0bf97cb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046440 Jul 29 06:32:57.970455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 393/796] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:58.420118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:58.422594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:58.428931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:58.429394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:58.430244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:58.430686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:58.459613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d79f54f4-7e54-41d3-89f8-f7a47425eb7a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044235 Jul 29 06:32:58.460390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 404/797] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:58.707384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:58.707909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:58.714514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:58.715683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:58.716698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:58.717144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:58.846162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:32:58.853513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-440a13d8-d650-401f-a9f5-fbf034a73c75 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150301 Jul 29 06:32:58.854082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 394/798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:32:58.981918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:58.984085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:58.990585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:58.991031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:58.991783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:58.992214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:59.020721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c728ee0c-8f38-494b-af1a-3bdbd4e1fa20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043360 Jul 29 06:32:59.021264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 405/799] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:32:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:32:59.471630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:59.473821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:59.479811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:59.480254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:59.481642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:59.482080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:59.510424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-be660679-08b3-49e9-a1b9-6f1b92e57713 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042803 Jul 29 06:32:59.510972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 395/800] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:32:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:32:59.874956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:32:59.875575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:32:59.881826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:59.882279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:32:59.883045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:32:59.883488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:00.011753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:00.019389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-56f742dc-3da2-4d6d-b467-664c8317f536 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148253 Jul 29 06:33:00.019957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 406/801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:32:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:00.033503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:00.035672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:00.042089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:00.042568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:00.043925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:00.044360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:00.072274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-546a5aab-ccc6-476c-a584-4e128da34db9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042675 Jul 29 06:33:00.072852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 396/802] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:00.523127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:00.525356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:00.531463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:00.531922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:00.532724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:00.533166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:00.536790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:00.562471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-86e655c7-14c7-47f7-bb64-92adfae3298c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044045 Jul 29 06:33:00.563017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 407/803] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:01.041379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:01.042018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:01.053390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:01.053858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:01.054630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:01.055065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:01.084257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:01.086449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:01.093689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:01.094143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:01.094915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:01.095356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:01.126317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e30fb35f-0425-44b5-88cf-5915438ccc07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046261 Jul 29 06:33:01.126976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 408/804] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:01.187501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:01.194938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba74e5fa-61af-431a-85d1-c6726d340a66 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157535 Jul 29 06:33:01.195608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 397/805] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:01.575647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:01.577844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:01.584197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:01.584676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:01.585433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:01.585873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:01.614385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5ea012a0-1d23-4b90-9432-67f2e9431c09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043371 Jul 29 06:33:01.614927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 409/806] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:02.138585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:02.140741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:02.147199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:02.147661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:02.148429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:02.148898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:02.177897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3aee18e4-6909-47fe-8830-dcdbbc90095d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Jul 29 06:33:02.178440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 398/807] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:02.217708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:02.218328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:02.225340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:02.226131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:02.227035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:02.227643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:02.361371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:02.368850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bd5b4dd3-9c9a-4a23-8c07-bef127f134b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156116 Jul 29 06:33:02.369415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 410/808] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:02.626763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:02.628938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:02.634880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:02.635352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:02.636103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:02.637072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:02.668257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-99371e39-d257-4cde-9656-d04f530bbff1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045109 Jul 29 06:33:02.668922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 399/809] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:03.191113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:03.193274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:03.199417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:03.199888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:03.200676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:03.201115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:03.229776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d8cb07a7-d055-4e96-bb32-bdcb296b855d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042665 Jul 29 06:33:03.230997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 411/810] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:03.390097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:03.390721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:03.397276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:03.397731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:03.398497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:03.398942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:03.531223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:03.538763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-df4a70ee-caa6-4768-ac12-00925fa64b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152558 Jul 29 06:33:03.539327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 400/811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:03.680646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:03.682797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:03.688875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:03.689321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:03.690073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:03.690505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:03.718994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d74b443-a451-46c9-ae76-5c8f13d98880 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042275 Jul 29 06:33:03.719549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 412/812] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:04.243047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:04.245296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:04.251910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:04.252368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:04.253184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:04.253631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:04.283590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-16e22a19-7911-4b61-afaf-5d13ab53b051 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Jul 29 06:33:04.284143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 401/813] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:04.559664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:04.560208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:04.566612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:04.567057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:04.567804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:04.568234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:04.697593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:04.705074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22abe3dc-fdfe-44f4-9fb2-4c5a27238d4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149798 Jul 29 06:33:04.705641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 413/814] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:04.730870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:04.733061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:04.739493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:04.739946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:04.740736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:04.741175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:04.769695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-694b27ef-ae62-4486-9bdf-7105f472e8cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043355 Jul 29 06:33:04.770250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 402/815] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:05.296417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:05.298599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:05.304568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:05.305034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:05.305792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:05.306227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:05.334342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7221b5bf-29ea-4d4f-903c-0c77165536ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042532 Jul 29 06:33:05.334885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 414/816] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:05.726529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:05.727147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:05.733381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:05.733927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:05.734589 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:05.735028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:05.781968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:05.784250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:05.790798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:05.791252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:05.792014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:05.792453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:05.821728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cd24a520-f878-426e-9f22-19d9de37b047 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043693 Jul 29 06:33:05.822318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 415/817] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:05.865634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:05.873838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3263eca7-9718-4da3-a560-5de26ad62403 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151443 Jul 29 06:33:05.874400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 403/818] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:06.346264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:06.348443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:06.354416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:06.354879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:06.356189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:06.356655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:06.384916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b161104c-9e24-4aea-a17d-7b54029902e3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042655 Jul 29 06:33:06.385459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 416/819] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:06.835095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:06.837231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:06.844192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:06.844670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:06.845423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:06.845854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:06.870012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:06.875253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9750081e-2768-4a81-8efa-34fe8043b52f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044475 Jul 29 06:33:06.875806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 404/820] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:06.894917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:06.895525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:06.902626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:06.903091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:06.903843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:06.904277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:07.033955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:07.041610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d2e8f2f7-329f-4859-b936-7eec373b49fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150397 Jul 29 06:33:07.042159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 417/821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:07.397366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:07.399515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:07.405863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:07.406315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:07.407073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:07.407511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:07.436396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d9e0665-3be7-46b8-9665-c3ff81fc79d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042984 Jul 29 06:33:07.437006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 405/822] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:07.887478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:07.889645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:07.895646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:07.896199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:07.896853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:07.897284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:07.926747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1f2cc2fb-58bb-4b5e-84cb-746545f078b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043249 Jul 29 06:33:07.927289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 418/823] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:08.062751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:08.063302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:08.069707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:08.070160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:08.070945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:08.071380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:08.206441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:08.214258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1032814c-fd04-43dd-8e10-7e02a7e71720 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155397 Jul 29 06:33:08.215863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 406/824] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:08.448330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:08.450530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:08.456509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:08.457268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:08.458039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:08.458486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:08.487347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-04c8f56e-9732-43f6-9618-83f39e5412a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042965 Jul 29 06:33:08.487907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 419/825] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:08.938526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:08.940663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:08.946729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:08.947197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:08.947947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:08.948385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:08.976933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c6fa19fa-7cc9-49d2-916b-77c185354d30 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042387 Jul 29 06:33:08.977470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 407/826] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:09.236304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:09.236965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:09.243394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:09.243847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:09.244641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:09.245080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:09.381143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:09.389722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6a27f23a-ff8a-4431-a914-6658a8f31b08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157200 Jul 29 06:33:09.390296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 420/827] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:09.500411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:09.502499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:09.508915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:09.509364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:09.510118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:09.510552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:09.539970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7beb58a3-9fcf-451f-9502-e5af506d1c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044397 Jul 29 06:33:09.540517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 408/828] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:09.990335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:09.992454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:09.999183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:09.999630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:10.000379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:10.000837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:10.028782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c2ef2b36-4054-40c4-8647-73ecca942f97 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042327 Jul 29 06:33:10.029328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 421/829] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:10.411225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:10.412047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:10.418944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:10.419390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:10.420168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:10.420632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:10.553279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:10.555939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:10.562705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:10.563152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:10.563920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:10.564350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:10.573683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:10.581645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aa794a63-7110-4295-80d3-0b3218c5b71b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.174202 Jul 29 06:33:10.582498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 409/830] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:10.597299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1678bf93-fc20-4b25-a3d3-2634de76a103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048234 Jul 29 06:33:10.597861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 422/831] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:11.041680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:11.043792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:11.049905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:11.050353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:11.051118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:11.051556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:11.081176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2df76f5-fdcb-453a-bb67-9886d1173e4c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043730 Jul 29 06:33:11.081716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 410/832] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:11.605533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:11.606132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:11.610100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:11.612248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:11.612406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:11.612896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:11.613657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:11.614089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:11.618649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:11.619107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:11.619877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:11.620318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:11.650928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-27e87749-ab4a-4f8e-8d82-ddf635f7ea7a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Jul 29 06:33:11.651412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 411/833] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:11.746518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:11.748762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:11.755331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-63d96010-24d6-4cc6-91b8-d557446957b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154430 Jul 29 06:33:11.755903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 423/834] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:12.094401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:12.096525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:12.102698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:12.103156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:12.103929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:12.104394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:12.133435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e91d6e5b-0b64-4eef-93f1-6945580fb1d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043010 Jul 29 06:33:12.133982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 412/835] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:12.662976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:12.665158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:12.671931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:12.672381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:12.673179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:12.673617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:12.703329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5e4107a6-fe46-40f2-a7e9-83a3fe9ddcf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Jul 29 06:33:12.703888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 424/836] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:12.775163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:12.775787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:12.782481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:12.782937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:12.783711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:12.784155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:12.911746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:12.919866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a0f344c6-210c-425d-b187-3e226b35aa16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148581 Jul 29 06:33:12.920430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 413/837] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:13.146688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:13.148800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:13.155523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:13.155975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:13.156768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:13.157206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:13.185037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4614c1df-a8ce-4ca6-b57c-5311b957a3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042411 Jul 29 06:33:13.185580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 425/838] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:13.716118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:13.718302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:13.724368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:13.724851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:13.725624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:13.726061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:13.759654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-58120113-bb25-40b4-9185-25e451c310e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047603 Jul 29 06:33:13.760206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 414/839] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:13.941220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:13.941840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:13.948414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:13.948901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:13.949663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:13.950104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:14.082295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:14.090331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8aa0298-f6f6-4c28-a0cf-d00a3ab249db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152801 Jul 29 06:33:14.090895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 426/840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:14.197216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:14.199508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:14.205953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:14.206405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:14.207435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:14.207873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:14.237309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c551bc9d-3c62-422d-8901-75554274cbb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044025 Jul 29 06:33:14.237855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 415/841] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:14.770893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:14.773101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:14.779279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:14.779736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:14.780503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:14.780980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:14.809645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2e4604f7-5605-4a3d-9b8a-0652af69a3c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042601 Jul 29 06:33:14.810132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 427/842] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:15.111046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:15.111748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:15.118033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:15.118481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:15.119252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:15.119690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:15.250388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:15.251167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:15.252594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:15.258703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5506861-c555-4aeb-b5ee-e6d751431e74 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151495 Jul 29 06:33:15.259136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:15.265297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 416/843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:15.265486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:15.265486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:15.265486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:15.291214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-97f329fb-4fae-43f9-b8de-00d89e218261 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044751 Jul 29 06:33:15.291782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 428/844] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:15.822168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:15.826798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:15.833124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:15.833572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:15.834333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:15.834766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:15.864273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-50e088a0-c1ce-4f65-9383-23f28b932fee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046280 Jul 29 06:33:15.864853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 417/845] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:16.279923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:16.280529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:16.286970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:16.287415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:16.288169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:16.288636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:16.303442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:16.305612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:16.312084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:16.312554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:16.313320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:16.313781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:16.343927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a0f2186a-89ed-443d-931a-bd2c5dada1bb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044361 Jul 29 06:33:16.344493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 418/846] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:16.419366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:16.427049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7159df0f-4c18-43f3-81e1-03dc17e08788 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151704 Jul 29 06:33:16.427613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 429/847] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:16.876705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:16.878865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:16.884840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:16.885273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:16.886552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:16.886986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:16.915777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bdc26d44-8cc6-4939-b932-a70eb9db9d1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042956 Jul 29 06:33:16.916242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 419/848] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:17.357984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:17.360319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:17.366783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:17.367237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:17.368011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:17.368627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:17.401005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-74b2596f-ecc9-4ae0-bf85-dae4ea94be8f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047940 Jul 29 06:33:17.401584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 430/849] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:17.447108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:17.447732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:17.454542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:17.455000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:17.455773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:17.456215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:17.583701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:17.591909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a5a8f4b6-1dfc-4a97-8322-21b3835f9493 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148654 Jul 29 06:33:17.592479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 420/850] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:17.928267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:17.930532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:17.937167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:17.937612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:17.938372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:17.938801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:17.967149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-18d547a8-ff15-46c6-9296-c621a33f15ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 Jul 29 06:33:17.967688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 431/851] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:18.413617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:18.415783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:18.423077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:18.423077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:18.423862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:18.424304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:18.439921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:18.455734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f05b8d7b-fd26-4c35-924a-3d3b9966992d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046126 Jul 29 06:33:18.456362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 421/852] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:18.612733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:18.613345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:18.619729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:18.620182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:18.621474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:18.621922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:18.751031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:18.758554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d4a1d6a4-0c51-4c92-a4cd-ed4b074e35a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149667 Jul 29 06:33:18.759117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 432/853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:18.979397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:18.981494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:18.987482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:18.987930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:18.988724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:18.989157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:19.018267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0f5d4065-7598-4971-a86c-8abfad2df37b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Jul 29 06:33:19.018804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 422/854] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:19.468227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:19.470403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:19.476382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:19.476879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:19.477633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:19.478068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:19.506556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cd994e56-77e5-49ca-8a9e-ef49019bf607 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042420 Jul 29 06:33:19.507106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 433/855] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:19.781863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:19.782479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:19.789033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:19.789481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:19.790272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:19.790708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:19.925506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:19.933659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8f69590-a651-4ed2-b1dd-6061cc6daaf3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154945 Jul 29 06:33:19.934228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 423/856] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:20.031153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:20.033261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:20.039664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:20.040113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:20.040895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:20.041329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:20.069793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c0b0f7c7-d039-4400-acfb-8f4daba666af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Jul 29 06:33:20.070330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 434/857] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:20.519430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:20.521711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:20.528304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:20.528780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:20.529539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:20.529973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:20.558231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-46855677-674d-42fe-bf48-b486009a4d47 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042700 Jul 29 06:33:20.558781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 424/858] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:20.954272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:20.954882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:20.961083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:20.961534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:20.962285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:20.962715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:21.082153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:21.084322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:21.090734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:21.091189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:21.091959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:21.092401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:21.093556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:21.101164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-990c8452-307f-4461-986e-4ad5221156a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150669 Jul 29 06:33:21.101733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 435/859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:21.129933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4e5c73f4-1563-4c24-8c8b-5f58d5617103 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051901 Jul 29 06:33:21.130508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 425/860] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:21.570705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:21.572886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:21.579030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:21.579489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:21.580255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:21.580726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:21.610733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-88961dfc-1a08-493e-9893-b0420bdb77fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044082 Jul 29 06:33:21.611277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 436/861] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:22.122484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:22.123097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:22.130123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:22.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:22.131350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:22.131792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:22.142218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:22.144389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:22.150731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:22.151186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:22.152069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:22.152513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:22.182247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-415df613-2510-4bb7-be29-326a228cab2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043882 Jul 29 06:33:22.183435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 437/862] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:22.268083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:22.275777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-90da8228-41af-4f0b-84a6-946c82e35a1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157757 Jul 29 06:33:22.276954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 426/863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:22.623683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:22.625854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:22.631682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:22.632127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:22.632979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:22.633414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:22.661220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-260f1ab9-a31d-4aa1-b0f2-a173914def8a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042055 Jul 29 06:33:22.661759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 438/864] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:23.195778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:23.197842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:23.204595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:23.205170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:23.205933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:23.206368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:23.235502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a1ffa1d8-0069-446e-a75b-8b0802d2cc95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043788 Jul 29 06:33:23.236043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 427/865] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:23.297873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:23.298512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:23.304971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:23.305421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:23.306180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:23.306615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:23.435626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:23.443165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bf7812b5-b7b8-44e5-b2d2-7c20286b93a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149176 Jul 29 06:33:23.443725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 439/866] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:23.673806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:23.675926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:23.681931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:23.682376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:23.683374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:23.683832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:23.713003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-929725a1-6a67-487d-9a17-2e1f6657af74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043143 Jul 29 06:33:23.713545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 428/867] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:24.247469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:24.249707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:24.256295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:24.256784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:24.257559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:24.257999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:24.277258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:24.290722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-79a689eb-ae56-4a3e-9d60-eed0c2939e48 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047124 Jul 29 06:33:24.291191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 440/868] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:24.465094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:24.465828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:24.472579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:24.473212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:24.474086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:24.474592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:24.608688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:24.616089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-41d684d8-9eb7-4ff0-8b78-6a22dd3dab83 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155585 Jul 29 06:33:24.616676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 429/869] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:24.725836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:24.727969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:24.734611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:24.735086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:24.735881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:24.736312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:24.765553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dac489a0-a862-40ab-86cb-e2a1a81bd469 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043520 Jul 29 06:33:24.766037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 441/870] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:25.303011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:25.305201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:25.311442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:25.311893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:25.312684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:25.313123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:25.343290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-01c30c0a-78fc-4727-a6ef-ad5db08db7d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Jul 29 06:33:25.343836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 430/871] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:25.637761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:25.638378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:25.644850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:25.645304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:25.646062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:25.646501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:25.777429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:25.779611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:25.779735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:25.786109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:25.786571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:25.787067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c6790130-1c4e-4b45-8918-14c1191bd819 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153782 Jul 29 06:33:25.787349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:25.787629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 442/872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:25.787792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:25.817543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-30c62469-49ca-4881-b217-8a9ac11ea41a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044289 Jul 29 06:33:25.818082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 431/873] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:26.356177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:26.358340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:26.364287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:26.364779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:26.365533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:26.365972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:26.394835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a37b2443-e52b-4635-a7e8-8d3266242d43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043276 Jul 29 06:33:26.395378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 443/874] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:26.808758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:26.809377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:26.815927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:26.816385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:26.817196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:26.817646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:26.830479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:26.832924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:26.839689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:26.840135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:26.840922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:26.841357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:26.871094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-43127968-c13c-4d25-8311-8c8b54691d9e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044399 Jul 29 06:33:26.871873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 444/875] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:26.949859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:26.957485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b564854-a126-4bf7-a127-0ce31d75b973 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152851 Jul 29 06:33:26.958041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 432/876] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:27.408022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:27.410181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:27.412009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=86 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:27.417328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:27.417773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:27.418529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:27.418961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:27.447240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-adbbdd57-ca28-4d6d-87f3-d5418d3453b6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043488 Jul 29 06:33:27.447777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 445/877] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:27.883680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:27.885870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:27.892882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:27.893334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:27.894101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:27.894542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:27.923890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d7a4307-643d-43c6-99ab-884e7db50122 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044184 Jul 29 06:33:27.924428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 433/878] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:27.978259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:27.978871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:27.985871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:27.986267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:27.987022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:27.987456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:28.116142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:28.124287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22ad260a-6ebc-405e-8f8a-5401e537b969 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149862 Jul 29 06:33:28.124894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 446/879] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:28.460904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:28.463026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:28.464868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=82 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:28.470762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:28.471211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:28.472313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:28.472784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:28.501666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-171e9d01-2f64-44f4-8fc6-5f5286d3821a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Jul 29 06:33:28.502210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 434/880] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:28.936491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:28.938685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:28.945123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:28.945571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:28.946330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:28.946766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:28.975687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3961c408-b7b3-4c58-bafb-94b1a863a898 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043924 Jul 29 06:33:28.976232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 447/881] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:29.145645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:29.146263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:29.152869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:29.153329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:29.154104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:29.154548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:29.283444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:29.291080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e2507859-1191-4b5e-b422-0d49a2704f85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149383 Jul 29 06:33:29.291644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 435/882] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:29.513810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:29.515904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:29.522356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:29.522861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:29.523658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:29.524099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:29.553373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-534f673a-1cf8-4774-bfb3-9ced7c7858cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043605 Jul 29 06:33:29.553925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 448/883] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:29.988035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:29.990199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:29.996342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:29.996980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:29.997752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:29.998186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:30.026034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-103aae07-b722-4ffc-a963-5635faadc287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041947 Jul 29 06:33:30.026571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 436/884] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:30.312205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:30.312783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:30.318831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:30.319282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:30.320044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:30.320481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:30.450373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:30.458089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f731e1a-61bf-4582-8aed-2a15c44078ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149798 Jul 29 06:33:30.458630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 449/885] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:30.565557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:30.567609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:30.574116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:30.574567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:30.575320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:30.575747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:30.604219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-706eedbe-8d3d-4044-9e9d-4eb49fd7f1e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042657 Jul 29 06:33:30.604788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 437/886] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:31.039004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:31.041197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:31.047925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:31.048379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:31.049165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:31.049601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:31.080033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-171cc1a4-1b10-4bce-84ec-a162679716d5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044988 Jul 29 06:33:31.080599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 450/887] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:31.479258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:31.479864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:31.486074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:31.486515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:31.487269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:31.487702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:31.491561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:31.617097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:31.619351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:31.620402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:31.626012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:31.626458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:31.627216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:31.627648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:31.628709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5e730de6-d905-4420-aae5-e0579aeedb77 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153278 Jul 29 06:33:31.629291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 438/888] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:31.656246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6fb536a5-c03d-48a8-a0d0-cf4a5e2abd1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042924 Jul 29 06:33:31.656750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 451/889] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:32.092892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:32.095010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:32.100953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:32.101401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:32.102156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:32.102590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:32.130967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82a9bc65-a1f8-4071-ab13-eeebce68e458 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042175 Jul 29 06:33:32.131498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 439/890] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:32.650073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:32.650683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:32.657307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:32.657749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:32.658505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:32.658945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:32.667398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:32.670165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:32.676744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:32.677203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:32.677975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:32.678586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:32.711189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e7d1cf4c-1717-4ae7-8038-dc2a0c5a6386 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047729 Jul 29 06:33:32.711754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 440/891] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:32.791710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:32.799944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c8b93b3e-10fe-466e-9f36-ab5efb6692c3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153788 Jul 29 06:33:32.800524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 452/892] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:33.143725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:33.145896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:33.151801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:33.152247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:33.153605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:33.154036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:33.182311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f0d4024f-447a-498e-ae6e-b7cd53af6cb2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042506 Jul 29 06:33:33.182858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 441/893] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:33.723865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:33.725945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:33.733397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:33.733397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:33.734027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:33.734462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:33.763582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c483e680-f689-4fac-9b24-c0e93ef640a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Jul 29 06:33:33.764124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 453/894] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:33.820176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:33.820819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:33.828122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:33.828609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:33.829382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:33.829822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:33.957739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:33.965290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59dc928c-acf7-423a-bd00-8ebbf28a9ab5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148968 Jul 29 06:33:33.965862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 442/895] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:34.194589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:34.196767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:34.202910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:34.203351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:34.204124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:34.204592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:34.235155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-94f60687-8c42-466b-9793-66a457d88a42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044512 Jul 29 06:33:34.235712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 454/896] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:34.775613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:34.777734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:34.783854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:34.784306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:34.785097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:34.785530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:34.816217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-20d4be67-acc1-4cb3-ab03-cee1da85c009 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044573 Jul 29 06:33:34.816808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 443/897] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:34.986099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:34.986738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:34.993272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:34.993725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:34.994482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:34.994930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:35.127590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:35.135272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8d69103-82f4-4126-8505-59aba53ed2fa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153090 Jul 29 06:33:35.135826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 455/898] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:35.247554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:35.249719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:35.256058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:35.256506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:35.257292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:35.257725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:35.286440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-44a80046-a075-4568-b1bf-19393be91a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042861 Jul 29 06:33:35.286987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 444/899] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:35.828331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:35.830488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:35.836701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:35.837150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:35.837905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:35.838335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:35.868089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4eb153ed-dc39-4331-9996-fe1f25f47e85 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Jul 29 06:33:35.868648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 456/900] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:36.157709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:36.158325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:36.164438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:36.164932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:36.165694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:36.166131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:36.300586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:36.306149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:36.308887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:36.309718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-83768820-a69d-4cf5-b945-f95ad0642a8a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155460 Jul 29 06:33:36.310800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 445/901] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:36.316160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:36.316636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:36.317407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:36.317845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:36.321485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:36.349378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aefc1891-535d-4445-bfc8-a9b20c6fa191 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053889 Jul 29 06:33:36.349937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 457/902] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:36.880691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:36.882901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:36.889231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:36.889685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:36.890464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:36.890909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:36.920501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0204b32c-3668-4c8b-9a29-040eb76d56c9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Jul 29 06:33:36.921093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 446/903] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:37.331389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:37.332182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:37.338719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:37.339172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:37.340606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:37.341051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:37.362795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:37.364938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:37.371338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:37.371822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:37.372613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:37.373045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:37.402684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1b5b51b7-5f87-4720-8c0b-937fc99f6f46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043323 Jul 29 06:33:37.407378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 447/904] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:37.477924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:37.486211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-58cd35bc-d811-46d0-8db1-e8188674f1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.158760 Jul 29 06:33:37.486806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 458/905] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:37.932815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:37.935534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:37.941589 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:37.942029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:37.942797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:37.943241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:37.972376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9889db23-4ccc-4422-afcb-bab8cf63ffbf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043532 Jul 29 06:33:37.972963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 448/906] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:38.415154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:38.417356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:38.425447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:38.426004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:38.426827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:38.427309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:38.457849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-198f16af-428f-4c9b-b706-dcc21b9f2abd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046622 Jul 29 06:33:38.458403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 459/907] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:38.507481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:38.508089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:38.514666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:38.515110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:38.515868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:38.516301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:38.643157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:38.650537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-468b9c3d-ce03-4087-aa54-fd361c1b413e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146971 Jul 29 06:33:38.651103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 449/908] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:38.985788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:38.987854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:38.993859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:38.994319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:38.995080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:38.995534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:39.023779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6a495a10-b0e3-4483-b9ed-baf677e96a01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Jul 29 06:33:39.024359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 460/909] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:39.470325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:39.472466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:39.478531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:39.478991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:39.479755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:39.480202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:39.510512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-55190a93-ecee-4914-b438-29516a78eced tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044138 Jul 29 06:33:39.511182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 450/910] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:39.671763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:39.672287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:39.678787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:39.679220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:39.679976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:39.680412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:39.810520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:39.818016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3d1db777-6233-4eae-8687-8f9095194afb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150514 Jul 29 06:33:39.818646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 461/911] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:40.036688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:40.038812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:40.045820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:40.046272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:40.047029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:40.047471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:40.076121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2fd0a929-446b-44e1-8699-13289196df19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Jul 29 06:33:40.076689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 451/912] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:40.523519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:40.525729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:40.531793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:40.532248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:40.533041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:40.533477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:40.562225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e24b5b58-cb02-4256-9c9b-1287503c1937 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042701 Jul 29 06:33:40.562770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 462/913] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:40.840144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:40.840818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:40.846865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:40.847323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:40.848119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:40.848584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:40.980981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:40.988419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f58df3a9-4617-4316-aa2f-b9e87d872809 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152139 Jul 29 06:33:40.989004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 452/914] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:41.088805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:41.091511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:41.097859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:41.098317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:41.099087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:41.099530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:41.128129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-314607f5-4789-411b-ae5d-a1bb096b7c0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043293 Jul 29 06:33:41.128707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 463/915] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:41.574781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:41.577046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:41.583985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:41.584430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:41.585222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:41.585653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:41.615011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-26edad79-57d1-4594-bbbe-2f96ee12e146 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044391 Jul 29 06:33:41.615556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 453/916] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:42.010104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:42.010643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:42.016861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:42.017313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:42.018074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:42.018511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:42.141142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:42.143330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:42.149391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:42.149849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:42.150620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:42.151056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:42.151470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:42.159736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3fdd9262-2d68-4827-84ed-5dd7bfe314ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153576 Jul 29 06:33:42.160521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 464/917] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:42.176716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:42.181226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3d1c2e43-926a-4f4b-88b5-1eeeb101b1a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Jul 29 06:33:42.181779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 454/918] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:42.627919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:42.630098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:42.635997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:42.636557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:42.637319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:42.637747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:42.666282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-af04b97e-294d-4ada-8728-7064eee359e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042338 Jul 29 06:33:42.666821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 465/919] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:43.181334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:43.181951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:43.189705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:43.190165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:43.190939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:43.191385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:43.193477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:43.195675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:43.202424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:43.202876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:43.203668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:43.204140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:43.234351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f3820121-a8ba-4884-b1c7-30d2f26c580b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044679 Jul 29 06:33:43.235120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 466/920] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:43.321509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:43.328974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24727e8c-e574-44e6-9a9c-8b6ea5b365f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151512 Jul 29 06:33:43.329535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 455/921] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:43.679514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:43.681680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:43.687897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:43.688355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:43.689161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:43.689605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:43.720173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2265944b-93f5-47ec-a30a-f97a4a634be9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044580 Jul 29 06:33:43.720771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 467/922] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:44.247293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:44.249484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:44.255989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:44.256437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:44.257231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:44.257664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:44.286871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f5788aba-8a8c-41d7-bb51-45c6e0fe82c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044190 Jul 29 06:33:44.287423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 456/923] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:44.349883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:44.350491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:44.357480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:44.357926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:44.358673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:44.359102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:44.488294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:44.496384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-93b27799-fcc9-46ac-9c19-0495ec8f3694 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149773 Jul 29 06:33:44.496971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 468/924] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:44.732828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:44.734965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:44.741004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:44.741456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:44.742229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:44.742664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:44.770651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a8cc39d-a937-4a50-8dac-02040c090b67 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042475 Jul 29 06:33:44.771200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 457/925] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:45.299621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:45.301784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:45.307819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:45.308317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:45.309339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:45.309778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:45.338832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4652e982-b2bc-49cc-a7cc-d4938725b51e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043190 Jul 29 06:33:45.339466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 469/926] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:45.518449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:45.519068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:45.525714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:45.526172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:45.527023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:45.527531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:45.657601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:45.665063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-93b45596-960d-48ca-aaf4-a135bb025892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150506 Jul 29 06:33:45.665632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 458/927] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:45.783037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:45.785211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:45.791614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:45.792078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:45.792951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:45.793384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:45.822147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac86c58f-0061-4983-8358-978037815a39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043109 Jul 29 06:33:45.822696 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 470/928] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:46.351892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:46.354086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:46.361089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:46.361545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:46.362312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:46.362751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:46.390853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc09bd79-f03a-4c2c-8c37-c900061b6f03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043178 Jul 29 06:33:46.391396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 459/929] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:46.686533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:46.687073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:46.693132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:46.693589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:46.694350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:46.694792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:46.826899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:46.834767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4bbd3c9a-602e-40b7-9ea6-ac00ac3d576d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152326 Jul 29 06:33:46.835069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:46.835473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 471/930] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:46.837403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:46.844870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:46.845337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:46.846107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:46.846778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:46.876649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1563efb3-7db8-4359-9c8e-d45af5499c69 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045691 Jul 29 06:33:46.877199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 460/931] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:47.403335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:47.405626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:47.411817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:47.412267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:47.413084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:47.413545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:47.442887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8a36488a-5492-465e-a924-ea5b1b1b2325 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043588 Jul 29 06:33:47.443435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 472/932] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:47.856827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:47.857445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:47.863909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:47.864363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:47.865162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:47.865603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:47.889926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:47.892126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:47.899105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:47.899551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:47.900322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:47.900827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:47.926894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:47.934391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f4802bca-e01e-47f2-bcec-13929ce0a504 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049218 Jul 29 06:33:47.934979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 473/933] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:48.146725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:48.155002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68afe435-53c5-4746-aa21-1af890c5c24f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.302054 Jul 29 06:33:48.155556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 461/934] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:48.456397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:48.458742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:48.464781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:48.465231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:48.465991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:48.466426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:48.493989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-07222eeb-6d71-4b48-b368-e904dfe33d20 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041877 Jul 29 06:33:48.494539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 474/935] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:33:48.947321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:48.950423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:48.957155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:48.957607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:48.958366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:48.958799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:48.989060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-083310b2-6531-4398-9600-399f25b21172 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045685 Jul 29 06:33:48.989533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 462/936] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:49.175611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:49.176218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:49.182681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:49.183706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:49.184949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:49.185413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:49.316730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:49.325126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-111321b0-ff81-4875-bfca-663750167496 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153251 Jul 29 06:33:49.325690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 475/937] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:33:49.506738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:49.508881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:49.515639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:49.516028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:49.516832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:49.517276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:49.545507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4cc76ff1-a563-4254-9676-ef87a2e62a3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042782 Jul 29 06:33:49.546051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 463/938] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:50.001803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:50.003930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:50.010046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:50.010490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:50.011906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:50.012527 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:50.040503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-393d2a14-31a7-49c1-ae22-3cf2305ab4b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042697 Jul 29 06:33:50.041063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 476/939] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:50.346193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:50.346846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:50.353316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:50.353760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:50.354518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:50.355455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:50.483505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:50.490931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-417e3a53-9cac-41d7-92a4-398c04f9d53b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148579 Jul 29 06:33:50.491484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 464/940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:50.558613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:50.560815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:50.567451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:50.567910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:50.568703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:50.569149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:50.598033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c11cbe2b-ef72-4992-8609-d90f0060e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044118 Jul 29 06:33:50.598516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 477/941] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:51.053004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:51.055181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:51.061478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:51.061931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:51.062690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:51.063136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:51.093053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6c6fdd03-5309-47ca-ba72-e7fd8bdb56a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044125 Jul 29 06:33:51.093590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 465/942] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:51.387781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:33:51.388459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:33:51.513350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:51.513960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:51.519908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:51.520360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:51.521155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:51.521595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:51.611235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:51.613358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:51.619332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:51.619784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:51.621178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:51.621618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:51.651269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-413db882-29ee-4d27-95b9-f282c307c812 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Jul 29 06:33:51.652066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 466/943] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:51.653725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:51.661304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-93f26003-9ff7-49b0-ba72-632e8ff54985 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152579 Jul 29 06:33:51.661851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 478/944] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:52.106199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:52.108312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:52.114807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:52.115261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:52.116032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:52.116477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:52.147219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ae918025-11a4-4c6d-a53d-0f787693f9f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045590 Jul 29 06:33:52.147744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 467/945] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:52.664027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:52.666165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:52.672316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:52.672804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:52.673558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:52.673986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:52.683082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:52.683698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:52.689705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:52.690154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:52.690929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:52.691370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:52.704687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1cfc069b-5a4b-45df-982a-5f93cfbef88e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045125 Jul 29 06:33:52.705484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 479/946] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:52.825312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:52.832923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ed219541-99f4-49f2-90f9-1b626447e50f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153804 Jul 29 06:33:52.833470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 468/947] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:53.159055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:53.161217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:53.167162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:53.167607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:53.168358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:53.168814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:53.196880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-44ca5126-5055-4f6d-a298-30b709200514 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041847 Jul 29 06:33:53.197413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 480/948] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:53.717762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:53.719922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:53.726759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:53.727207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:53.727974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:53.728408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:53.758411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e3fd2408-02de-4108-8352-633678a1353f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Jul 29 06:33:53.758954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 469/949] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:53.854390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:53.855584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:53.861688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:53.862135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:53.862881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:53.863313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:53.994185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:54.001747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a6762e59-3d2a-4d80-bf07-c47adf998a7e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151171 Jul 29 06:33:54.002310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 481/950] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:54.210545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:54.212684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:54.218850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:54.219296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:54.220048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:54.220480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:54.250648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5cd568e-946f-4a2a-9582-f6046a388ab2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044739 Jul 29 06:33:54.251225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 470/951] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:54.770648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:54.772881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:54.778927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:54.779380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:54.780139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:54.780615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:54.809494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2865a4fd-11db-412f-9934-33888e5f202e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042833 Jul 29 06:33:54.810042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 482/952] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:55.022871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:55.023412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:55.030135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:55.030587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:55.031349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:55.031788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:55.046753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:55.157331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:55.164758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-61066ae5-bd3e-4330-808f-a339cab53765 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146070 Jul 29 06:33:55.165319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 471/953] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:55.263293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:55.265463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:55.271966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:55.272421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:55.273280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:55.273665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:55.303030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8d849031-edfc-4a2f-a782-8bc6d26e57da tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Jul 29 06:33:55.303574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 483/954] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:55.821154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:55.823792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:55.830150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:55.830634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:55.831383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:55.832069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:55.860953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06d51064-649e-409d-a8ba-d72ebc53a582 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Jul 29 06:33:55.861485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 472/955] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:56.187986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:56.188634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:56.194628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:56.195071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:56.195819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:56.196251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:56.316065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:56.318284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:56.325901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:56.326057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:56.326474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:56.327140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:56.327581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:56.333956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8af8f7d6-25c6-4d90-ba10-1ab4d348a528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151681 Jul 29 06:33:56.334529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 484/956] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:56.358250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0e42d12b-dd75-4eff-9b5c-6d9661575993 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046716 Jul 29 06:33:56.358797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 473/957] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:56.873603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:56.876257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:56.882247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:56.882697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:56.883451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:56.883885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:56.913254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-64d9349b-cc2f-4a9a-ab3f-011034f87882 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Jul 29 06:33:56.913804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 485/958] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:57.356255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:57.356901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:57.363635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:57.364149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:57.364961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:57.365404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:57.371454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:57.374174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:57.380484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:57.380960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:57.381715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:57.382149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:57.411822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-64cd840e-8b00-4477-9b2f-782bb14ec6b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045006 Jul 29 06:33:57.412411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 486/959] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:33:57.498785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:57.506322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ab78df7-9935-414b-8c6d-17af88ff720b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154485 Jul 29 06:33:57.506881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 474/960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:57.927546 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:57.929729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:57.931594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:57.937489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:57.937943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:57.938709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:57.939147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:57.969096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b9b7818c-6d4e-4985-910c-79b1032db05b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045484 Jul 29 06:33:57.969652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 487/961] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:58.424195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:58.426748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:58.434159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:58.434695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:58.435516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:58.435946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:58.465162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-30fff55e-84cb-4e54-8300-7addb6953065 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045132 Jul 29 06:33:58.465706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 475/962] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:58.527150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:58.527797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:58.534457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:58.534912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:58.535688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:58.536132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:58.667979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:58.675487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8c6d55a8-d13d-4636-b299-f296fbbcedc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152143 Jul 29 06:33:58.675994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 488/963] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:33:58.981867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:58.983909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:58.985813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:33:58.990970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:58.991418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:58.992173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:58.992632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:59.020704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34984e78-51af-4aad-b64b-8b7f36103b15 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043481 Jul 29 06:33:59.021233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 476/964] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:33:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:33:59.477624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:59.480320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:59.486309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:59.486760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:59.487515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:59.487947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:59.517115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-27516d9b-912c-47cc-a08a-884ea3cd719a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043509 Jul 29 06:33:59.517664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 489/965] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:33:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:33:59.696699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:33:59.697225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:33:59.703816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:59.704262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:59.705049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:33:59.705486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:33:59.834699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:33:59.842676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-64f27929-f91b-4564-b2a9-e6349928e210 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149904 Jul 29 06:33:59.843227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 477/966] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:33:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:00.033406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:00.035454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:00.042517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:00.042983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:00.043736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:00.044169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:00.058156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:00.073841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-efcc97bc-8fdb-4566-8640-59f35c49ef37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Jul 29 06:34:00.074378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 490/967] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:00.530766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:00.532919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:00.538969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:00.539422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:00.540179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:00.540662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:00.569753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bbe5b441-2154-4192-8af6-e2f6c1dd90a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044143 Jul 29 06:34:00.570283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 478/968] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:00.864106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:00.864742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:00.871709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:00.872161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:00.872948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:00.873401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:00.999714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:01.007157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd6f8b93-88df-4e04-b8fe-ca7a39cf8267 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146954 Jul 29 06:34:01.007718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 491/969] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:01.086413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:01.088651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:01.095427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:01.095887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:01.096689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:01.097136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:01.126861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-86610156-e841-41a1-90cf-3fb5413237c8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Jul 29 06:34:01.127331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 479/970] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:01.582974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:01.585191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:01.592745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:01.593197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:01.593972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:01.594408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:01.623122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0083e1ed-1ed0-4814-b77d-cf98a8d17137 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044408 Jul 29 06:34:01.623670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 492/971] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:02.029373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:02.029915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:02.035901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:02.036350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:02.037150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:02.037588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:02.139208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:02.141399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:02.147483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:02.147934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:02.148731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:02.149170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:02.163432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:02.171997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc236663-33a1-4efc-9d3a-2f58e2ed1fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147149 Jul 29 06:34:02.172584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 480/972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:02.179096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e92902ad-9a91-4c2e-8312-4d61f33850f0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Jul 29 06:34:02.179642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 493/973] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:02.635981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:02.638200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:02.644177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:02.644694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:02.645466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:02.645911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:02.674962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2fc3facd-3b98-4d7d-ace9-5baf27837804 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043422 Jul 29 06:34:02.675733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 481/974] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:03.190788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:03.192796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:03.193178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:03.193426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:03.199908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:03.200354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:03.200518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:03.201005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:03.201240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:03.201677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:03.201786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:03.202211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:03.230968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3a86d9cf-d6ed-458b-a187-1172a8ae1de1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044117 Jul 29 06:34:03.231775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 494/975] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:03.333252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:03.341232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2dd28b6a-03da-4789-9d1f-55c55a3ed55e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152327 Jul 29 06:34:03.341790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 482/976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:34:03.687954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:03.690114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:03.696182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:03.696662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:03.697419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:03.697851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:03.727103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-243ffb7f-315e-436c-a6b4-45549f382b06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043191 Jul 29 06:34:03.727666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 495/977] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:04.242938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:04.245174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:04.251623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:04.252081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:04.252920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:04.253363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:04.281730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc9dc64b-54fb-42a0-b378-bb6f28731af8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042870 Jul 29 06:34:04.282274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 483/978] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:04.362144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:04.362761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:04.369229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:04.369679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:04.370460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:04.370892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:04.500095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:04.507627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eae69c99-a6ae-452d-930d-2359707fafaa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149219 Jul 29 06:34:04.508247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 496/979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:04.739915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:04.742122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:04.748319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:04.748760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:04.749536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:04.749978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:04.779149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-df88162a-2e26-418d-867d-6e2c16a3b9c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043242 Jul 29 06:34:04.779701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 484/980] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:05.294170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:05.296347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:05.302347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:05.302799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:05.303554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:05.303994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:05.333071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bb060023-7d90-4123-99d9-4989666a3d8b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042859 Jul 29 06:34:05.333606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 497/981] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:05.529558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:05.530177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:05.536661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:05.537110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:05.537873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:05.538310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:05.667098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:05.674736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8835ef81-7c7c-483a-933a-05b91f310004 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149803 Jul 29 06:34:05.675297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 485/982] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:05.792818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:05.794961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:05.801442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:05.801899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:05.802666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:05.803106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:05.831436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-84421358-3343-4f18-9db9-509e5cd9e3b5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043416 Jul 29 06:34:05.832247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 498/983] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:06.345263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:06.347443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:06.353445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:06.353900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:06.355199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:06.355664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:06.385886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1c20432a-1c6a-4ac2-bf21-a24f810966e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Jul 29 06:34:06.386434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 486/984] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:06.696701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:06.697317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:06.703294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:06.703737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:06.704523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:06.704977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:06.839771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:06.844108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:06.846288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:06.847309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-925f3df1-8a98-4316-8a75-cf2494b5c8e8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154508 Jul 29 06:34:06.847877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 499/985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:06.852812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:06.853268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:06.854048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:06.854491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:06.883029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dffe12fd-4cd7-4d7f-95c3-de010cc7cb7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042852 Jul 29 06:34:06.883580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 487/986] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:07.398628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:07.400859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:07.406981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:07.407429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:07.408195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:07.408662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:07.437599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c4f465c3-ac9d-406b-851b-ee4aa15c2a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043179 Jul 29 06:34:07.438152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 500/987] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:07.868502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:07.869135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:07.876240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:07.876725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:07.877486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:07.877915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:07.881781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:07.898908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:07.901147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:07.907595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:07.908056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:07.908858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:07.909303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:07.940643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5f1b07de-3aca-4f3d-8fe1-1f0d21bab218 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045688 Jul 29 06:34:07.941215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 501/988] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:08.010505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:08.018105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-66ba42cd-355e-491a-8ef0-b4ff3700fb68 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153515 Jul 29 06:34:08.018661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 488/989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:08.450355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:08.452488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:08.458754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:08.459222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:08.459979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:08.460416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:08.491177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e4f7e874-2006-447a-b0b2-ad5e5c8d837d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Jul 29 06:34:08.491727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 502/990] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:08.953425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:08.955643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:08.962356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:08.962803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:08.964090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:08.964620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:08.993330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1cbe92f3-4735-4672-8b6b-6e6cd8736931 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043844 Jul 29 06:34:08.993796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 489/991] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:09.039433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:09.040042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:09.047476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:09.047927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:09.048717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:09.049157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:09.176583 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:09.184175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e34b8e15-7c28-49ae-b9e2-9ac534c41982 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148486 Jul 29 06:34:09.184770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 503/992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:09.503304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:09.505467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:09.512132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:09.512613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:09.513369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:09.513801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:09.542034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2ed43a5-b3f5-49f7-ab87-5752f8fe10c7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042437 Jul 29 06:34:09.542576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 490/993] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:10.005777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:10.007826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:10.014009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:10.014462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:10.015254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:10.015694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:10.044571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c1d4f6ba-5773-4593-a0ec-93b3f1f14289 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042795 Jul 29 06:34:10.045158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 504/994] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:10.204915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:10.205532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:10.212165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:10.212646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:10.214215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:10.214850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:10.344015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:10.351386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-67d658bd-17ab-4459-af69-8d4c8de6cabb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150306 Jul 29 06:34:10.351939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 491/995] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:10.554315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:10.556413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:10.563067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:10.563517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:10.564273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:10.564739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:10.594519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac0dd2a2-a297-44c6-b720-73057d779f06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044209 Jul 29 06:34:10.595151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 505/996] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:11.057758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:11.060268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:11.066542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:11.066991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:11.067767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:11.068203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:11.098902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-751ca0d5-ff9b-4eff-86ee-fa4d8b2cfdca tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045793 Jul 29 06:34:11.099441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 492/997] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:11.373563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:11.374499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:11.381004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:11.381455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:11.382219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:11.382657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:11.528173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:11.535973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-adcb7fed-7bf5-4fdb-8b25-c9063e7cce92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.166698 Jul 29 06:34:11.536562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 506/998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:11.607189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:11.609387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:11.615892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:11.616337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:11.617143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:11.617580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:11.647647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6f054eaf-cfd7-4e4a-ae6f-53557de66796 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044364 Jul 29 06:34:11.648163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 493/999] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:12.111459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:12.113633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:12.120020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:12.120467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:12.121266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:12.121701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:12.124004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:12.151549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e163e7c2-4269-4737-b0c6-53cb6730a44a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043474 Jul 29 06:34:12.152090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 507/1000] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:12.558508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:12.559124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:12.565480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:12.566056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:12.566838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:12.567338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:12.660649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:12.662803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:12.669826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:12.670285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:12.671094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:12.671559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:12.700471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:12.701003 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cd85d82c-85b7-4aac-a875-14eb2dd2e63d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043931 Jul 29 06:34:12.701334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 508/1001] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:12.708528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-01edcbd7-c0fb-4838-9e69-f9c2bda84043 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154416 Jul 29 06:34:12.709115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 494/1002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:13.163829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:13.165977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:13.172950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:13.173399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:13.174159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:13.174593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:13.204582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-28f3eb75-137b-4e7c-b7a9-7f2aed670ac5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044752 Jul 29 06:34:13.205124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 509/1003] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:13.713353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:13.715386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:13.721937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:13.722387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:13.723160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:13.723597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:13.754485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-65b97a8a-823d-40ed-bb0e-24536ba37a6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045193 Jul 29 06:34:13.755044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 495/1004] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:13.829068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:13.829673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:13.835901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:13.836343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:13.837127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:13.837555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:13.965941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:13.973311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c1b18a18-67e5-4512-9d97-0c9aa5dfafcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.247188 Jul 29 06:34:13.973904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 510/1005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:34:14.217782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:14.219887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:14.225871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:14.226320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:14.227082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:14.227522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:14.257839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7c613d56-1680-48ca-939a-c99fb5160d12 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Jul 29 06:34:14.258386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 496/1006] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:14.767286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:14.769606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:14.776713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:14.777199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:14.777968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:14.778408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:14.807892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-21e9def5-069b-4dd1-8b4c-c8824dea6615 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Jul 29 06:34:14.808445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 511/1007] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:14.995336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:14.995880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:15.002404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:15.002855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:15.003619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:15.004056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:15.270354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:15.272470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:15.279031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:15.279476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:15.280235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:15.280689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:15.311019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b80bd28d-0464-4bf8-a90a-8e97711b48c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044601 Jul 29 06:34:15.311580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 512/1008] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:15.339719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:15.347015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e70b79f4-36c7-481a-bc14-07123575f3b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.356145 Jul 29 06:34:15.347573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 497/1009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:15.820379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:15.823179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:15.829788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:15.830240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:15.831001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:15.831442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:15.860446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d87e2958-235a-4393-8612-86cc6dc343c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Jul 29 06:34:15.861027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 513/1010] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:16.324685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:16.326902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:16.333670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:16.334126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:16.334895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:16.335336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:16.364867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d34deea4-0e8c-4aff-b660-79379c1b40aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045317 Jul 29 06:34:16.365424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 498/1011] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:16.368228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:16.368927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:16.374970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:16.375425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:16.376188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:16.376656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:16.504282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:16.511800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b67ef93-bdf1-41c8-bfb8-f9ed0346784e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147466 Jul 29 06:34:16.512369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 514/1012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:34:16.872689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:16.874823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:16.880784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:16.881238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:16.881992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:16.882427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:16.913149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-db4123a8-e4f2-41eb-8158-c42a76a0233d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Jul 29 06:34:16.913697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 499/1013] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:17.376804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:17.378936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:17.385762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:17.386215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:17.386977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:17.387415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:17.415376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9e2636ae-6858-47e6-8bc8-47a2b89fba32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042669 Jul 29 06:34:17.415919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 515/1014] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:17.532887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:17.533501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:17.539918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:17.540366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:17.541159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:17.541946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:17.669685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:17.677140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a68b1c1-88ad-4d4a-95af-f7840a61533f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148072 Jul 29 06:34:17.677698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 500/1015] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:17.925776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:17.927816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:17.934466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:17.934908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:17.935655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:17.936084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:17.964945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fa213157-689a-4d7f-b3f4-569f6c738e2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Jul 29 06:34:17.965487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 516/1016] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:18.428896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:18.431084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:18.437842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:18.438295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:18.439061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:18.439500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:18.468631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b23a94d-05b8-4c69-acb1-10bcf8a293b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043768 Jul 29 06:34:18.469173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 501/1017] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:18.699124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:18.699702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:18.706221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:18.706936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:18.707693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:18.708131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:18.843933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:18.851344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d2c37300-5abf-4850-ab1f-b5507827e4ce tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156591 Jul 29 06:34:18.851901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 517/1018] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:18.977162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:18.979277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:18.985638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:18.986084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:18.986841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:18.987276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:19.015512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2d9e46e6-719e-4071-8d26-ab43fbc40a2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042378 Jul 29 06:34:19.016046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 502/1019] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:19.480632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:19.482796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:19.489248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:19.489695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:19.490456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:19.490893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:19.520314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9e20ce5a-37b5-481e-be63-efc1f95e7c0a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043943 Jul 29 06:34:19.520894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 518/1020] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:19.872859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:19.873469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:19.879585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:19.880035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:19.880829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:19.881263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:20.011720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:20.019207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-20cd026f-954b-4687-b219-29bb253841a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150871 Jul 29 06:34:20.019776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 503/1021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:20.027995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:20.030237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:20.036656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:20.037111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:20.037871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:20.038309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:20.066739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f551f2ef-8188-4d84-8d07-707867f7c1ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Jul 29 06:34:20.067276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 519/1022] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:20.532982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:20.535173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:20.541272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:20.541760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:20.542527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:20.542963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:20.567041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:20.572212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-14c35bdc-c646-46b6-a574-ad4f75067a02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043309 Jul 29 06:34:20.573592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 504/1023] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:21.040894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:21.042292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:21.048735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:21.049184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:21.049932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:21.050363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:21.079737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:21.082308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:21.089699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:21.090233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:21.091112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:21.091560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:21.121392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-823d9ca7-38ac-458a-8c9b-4f1e10d78822 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045524 Jul 29 06:34:21.121957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 505/1024] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:21.178515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:21.185983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3dc4b4eb-8beb-4002-8223-027d06e8ea42 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148924 Jul 29 06:34:21.186535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 520/1025] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:21.585401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:21.587543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:21.593805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:21.594256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:21.595019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:21.595457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:21.624763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-00c0c341-c2ae-4c4f-835c-5d4a880a24fb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043638 Jul 29 06:34:21.625302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 506/1026] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:22.133710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:22.136494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:22.143336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:22.143799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:22.144603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:22.145050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:22.175165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f6f22982-9c37-4fa1-a290-37d2aa4b8b0f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Jul 29 06:34:22.175716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 521/1027] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:22.207231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:22.207847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:22.214661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:22.215114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:22.215881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:22.216319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:22.347058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:22.354773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-867e8df8-41f6-486c-9020-fa67d5ec0942 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151579 Jul 29 06:34:22.355324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 507/1028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:22.638942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:22.641087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:22.647638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:22.648089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:22.648890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:22.649327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:22.678669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0b29e0ad-6b4d-45ef-b38e-9c212e7df2e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043741 Jul 29 06:34:22.679211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 522/1029] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:23.187560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:23.189663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:23.195708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:23.196166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:23.196963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:23.197626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:23.227092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-62469c21-046b-44f2-b3b1-eec412091f1b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043550 Jul 29 06:34:23.227725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 508/1030] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:23.376027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:23.376656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:23.383057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:23.383505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:23.384251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:23.385250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:23.521705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:23.523855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:23.531286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b973bc90-89bd-4d9f-9a90-c5a498423dbf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.159030 Jul 29 06:34:23.531851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 523/1031] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:23.691388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:23.693543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:23.700766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:23.701219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:23.701983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:23.702423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:23.732292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34f0394e-681a-439a-aeac-dd2e51010a0e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044741 Jul 29 06:34:23.732806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 509/1032] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:24.240028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:24.242237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:24.248352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:24.248826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:24.249588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:24.250016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:24.278674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-47993e7c-59b6-46d8-b46c-7fd946474cb4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Jul 29 06:34:24.279210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 524/1033] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:24.552381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:24.552964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:24.559918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:24.560375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:24.561209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:24.561655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:24.692074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:24.700137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-41009904-d3aa-46ce-98fe-5ee54e021175 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151798 Jul 29 06:34:24.700725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 510/1034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:24.745272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:24.747416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:24.753437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:24.753896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:24.754668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:24.755114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:24.784927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-24cc7bb9-b3f3-4380-8d84-bdc674ae492b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044361 Jul 29 06:34:24.785477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 525/1035] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:25.290929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:25.293316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:25.299362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:25.299810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:25.300603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:25.301041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:25.330392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-02f17512-57da-4b6a-a383-f13c0323ed71 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Jul 29 06:34:25.330929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 511/1036] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:25.721597 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:25.722206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:25.729470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:25.729921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:25.730679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:25.731115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:25.797283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:25.799428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:25.806043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:25.807095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:25.808256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:25.808870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:25.838490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ce6c2146-1f3c-4d24-9334-224d5e4bf7f2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044823 Jul 29 06:34:25.839091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 512/1037] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:25.860431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:25.867874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b5a68d9e-84ab-456d-bb3b-ea1d11d56e08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150170 Jul 29 06:34:25.868426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 526/1038] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:26.342939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:26.345115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:26.351084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:26.351538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:26.352332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:26.352810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:26.380668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-df82875f-3527-479b-9ced-383b89766ea7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041778 Jul 29 06:34:26.381212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 513/1039] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:26.851012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:26.853197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:26.860245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:26.860737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:26.861510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:26.861952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:26.889246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:26.889852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:26.890751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-53b45e54-69db-4241-953d-2e36cea2b00e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043745 Jul 29 06:34:26.891377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 527/1040] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:26.896228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:26.896707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:26.897468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:26.897901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:27.026390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:27.033906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6a17646b-2a19-4cda-a929-cd2c040d8644 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148454 Jul 29 06:34:27.034456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 514/1041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:34:27.393590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:27.395763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:27.401859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:27.402317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:27.403085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:27.403528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:27.433103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9f7e158-ca8f-4102-b751-e0faeba4e565 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043347 Jul 29 06:34:27.433658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 528/1042] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:27.903786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:27.905945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:27.912660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:27.913112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:27.913873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:27.914312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:27.943530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-db4c4b8c-b806-4288-b591-528c9744c3e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044341 Jul 29 06:34:27.944084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 515/1043] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:28.055435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:28.056042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:28.058450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:28.063783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:28.064240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:28.065040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:28.065484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:28.196565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:28.204474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-db0c2d6f-e4fe-4051-b09a-87e6716a81fb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152860 Jul 29 06:34:28.205074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 529/1044] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:28.445341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:28.447657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:28.453752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:28.454211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:28.454977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:28.455431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:28.485509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0e568a9e-e52a-4db3-9f06-406896ed5d03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Jul 29 06:34:28.486057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 516/1045] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:28.956854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:28.959035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:28.965537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:28.965993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:28.966773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:28.967210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:29.144397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e2d0b75d-2d51-4d9f-b7a8-1103ac6aa815 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.191751 Jul 29 06:34:29.145085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 530/1046] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:29.225494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:29.226110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:29.229383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=82 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:29.234662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:29.235106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:29.235859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:29.236289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:29.367169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:29.374645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-98fde1b4-fe72-482d-a619-18d6fbc127d0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152976 Jul 29 06:34:29.375192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 517/1047] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:29.498183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:29.500290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:29.506270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:29.506731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:29.507505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:29.507949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:29.537759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7981202-5ae6-4ed1-a749-794a72ca20aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043794 Jul 29 06:34:29.538310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 531/1048] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:30.157034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:30.159268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:30.165381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:30.166383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:30.167114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:30.167549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:30.196261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-71a4a243-961d-45a3-8ed6-5692f992eabb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043327 Jul 29 06:34:30.196835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 518/1049] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:30.395830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:30.396435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:30.403503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:30.403946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:30.404733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:30.405164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:30.532143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:30.539588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5a073331-6bff-4d5e-bcb3-9a06d7784e2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147574 Jul 29 06:34:30.540142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 532/1050] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:30.549839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:30.552011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:30.558999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:30.559446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:30.560199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:30.560659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:30.589926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5fd99cf1-d797-421e-874a-7fe65bb44849 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043982 Jul 29 06:34:30.590467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 519/1051] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:31.209421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:31.211528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:31.218243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:31.218700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:31.219464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:31.219900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:31.250544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a2cd4df4-07e1-48fa-8517-2bf2a3574e33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045535 Jul 29 06:34:31.251119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 533/1052] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:31.559873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:31.560485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:31.567058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:31.567512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:31.568281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:31.568750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:31.602208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:31.604437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:31.611157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:31.611620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:31.612400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:31.612875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:31.643479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f50f106c-b447-477a-87ca-4f55f3ca4418 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045260 Jul 29 06:34:31.644038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 534/1053] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:31.700913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:31.708793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ecb7a5a5-212e-4e55-9475-f17a0829ccf8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152830 Jul 29 06:34:31.709360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 520/1054] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:32.262947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:32.265197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:32.271658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:32.272121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:32.272949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:32.273392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:32.304246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5248844a-c3dc-4964-b7db-3cde51a774f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045266 Jul 29 06:34:32.304828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 535/1055] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:32.656255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:32.659387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:32.666637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:32.667092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:32.667869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:32.668306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:32.683167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:32.699306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-42e1da2d-e9b1-4a22-b8bb-22d8f3b3e780 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047037 Jul 29 06:34:32.699846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 521/1056] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:32.731007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:32.731636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:32.738087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:32.738539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:32.739294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:32.739728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:32.869639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:32.877208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8a4c4947-5a8f-47ce-b9e8-61a26de98d35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150789 Jul 29 06:34:32.877778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 536/1057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:33.317170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:33.319359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:33.325890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:33.326337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:33.327097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:33.327533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:33.356210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-46c50d46-80e9-4996-a26a-b3ea38a1bb43 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043032 Jul 29 06:34:33.356775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 522/1058] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:33.711680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:33.714332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:33.720424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:33.720915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:33.721697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:33.722140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:33.751500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e8239789-0afd-440f-8dd9-d53f2a41e178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043707 Jul 29 06:34:33.752060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 537/1059] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:33.898027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:33.898645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:33.905776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:33.906228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:33.906995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:33.907437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:34.035218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:34.043291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-796345b8-3576-4fb3-9a53-5a1b8716f655 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149191 Jul 29 06:34:34.043850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 523/1060] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:34.368526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:34.370676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:34.376745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:34.377209 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:34.377978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:34.378421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:34.407131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-83654dd7-df16-41ef-b106-26f736b6729a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042558 Jul 29 06:34:34.407670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 538/1061] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:34.763940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:34.766228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:34.772171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:34.772657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:34.773412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:34.773866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:34.802806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5763eebc-6b9a-40a5-87ce-8534129784d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043402 Jul 29 06:34:34.803344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 524/1062] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:35.064900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:35.065409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:35.072354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:35.073465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:35.074226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:35.074664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:35.205551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:35.213234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a980c928-f8a7-4fc9-92c0-d83bd16abc43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152299 Jul 29 06:34:35.213783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 539/1063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:35.419895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:35.422042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:35.428499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:35.428975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:35.429729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:35.430163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:35.459536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-25e30d92-7994-492a-9e58-4f55d0ec9944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044102 Jul 29 06:34:35.460081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 525/1064] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:35.815063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:35.817184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:35.823969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:35.824417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:35.825203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:35.825632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:35.838998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:35.854994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b86a02d3-e7df-4f30-ae98-8f5031001832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Jul 29 06:34:35.855538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 540/1065] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:36.234385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:36.235036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:36.241121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:36.241591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:36.242346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:36.242785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:36.376989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:36.384358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-602043b7-c217-490c-a9b5-aa782fde4b13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153914 Jul 29 06:34:36.384937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 526/1066] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:36.471813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:36.473979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:36.481039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:36.481487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:36.482252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:36.482685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:36.511023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-229b5fc3-6f19-4db0-a085-05c253983974 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043029 Jul 29 06:34:36.511495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 541/1067] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:36.867094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:36.869923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:36.876710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:36.877236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:36.878070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:36.878640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:36.908779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-827a6123-ffc8-4b55-a9d0-de5c22da520d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045502 Jul 29 06:34:36.909343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 527/1068] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:37.405430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:37.406108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:37.412167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:37.412677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:37.413442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:37.413878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:37.523588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:37.526296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:37.533305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:37.533824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:37.534635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:37.535920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:37.549832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:37.558858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b4a73ff6-78ae-425b-8b94-60d0b1f423ea tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157120 Jul 29 06:34:37.559460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 542/1069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:37.574860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f11989c-ece6-4bc6-87a6-1415ebb4deba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055202 Jul 29 06:34:37.575459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 528/1070] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:37.921763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:37.924049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:37.930024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:37.930474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:37.931734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:37.932167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:37.961987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a0da9a0d-0ac2-4c56-b161-e1da1973a7ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044346 Jul 29 06:34:37.962612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 543/1071] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:38.582961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:38.584174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:38.587122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:38.589774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:38.591499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:38.592038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:38.592878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:38.593269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:38.597677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:38.598286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:38.599267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:38.599712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:38.630748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8f2dce3f-922a-43f2-aa3c-ea71367454f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047936 Jul 29 06:34:38.631317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 544/1072] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:38.809518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:38.817006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e69fb42d-2f47-4e98-ac65-7b399a990cf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.239755 Jul 29 06:34:38.817763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 529/1073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:38.974575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:38.976706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:38.982752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:38.983214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:38.983991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:38.984436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:39.014492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f388cb04-83d6-4735-ba8e-416305c77644 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Jul 29 06:34:39.015052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 545/1074] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:39.643419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:39.645599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:39.652138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:39.652611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:39.653370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:39.653804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:39.682081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c05b98ca-7eba-4eb0-b51c-1ba926049f08 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042693 Jul 29 06:34:39.682617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 530/1075] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:39.839178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:39.839798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:39.846309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:39.846784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:39.847541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:39.847981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:39.977937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:39.985467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-153e1794-73e1-4447-a991-c358aa9edd20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150785 Jul 29 06:34:39.985970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 546/1076] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:40.027066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:40.029224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:40.035247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:40.035698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:40.036458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:40.036914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:40.068924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b4220ab-dfc2-48de-8a97-8a15c1d9c899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046255 Jul 29 06:34:40.069469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 531/1077] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:40.694438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:40.697311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:40.703514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:40.703998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:40.704795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:40.705239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:40.735126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-63430dc7-379a-4a13-8c4b-540ab60d00e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044594 Jul 29 06:34:40.735695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 547/1078] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:41.006851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:41.007460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:41.013932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:41.014376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:41.015133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:41.015565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:41.082075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:41.084304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:41.091393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:41.091849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:41.093030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:41.093223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:41.122732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-abe3f415-33e3-4da4-b8ec-de916b248e16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044977 Jul 29 06:34:41.123302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 548/1079] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:41.145524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:41.153653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06eeb9bb-39ea-4329-afc4-0e90e2082d73 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150737 Jul 29 06:34:41.154207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 532/1080] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:41.748237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:41.750386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:41.756346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:41.756836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:41.757594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:41.758025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:41.786698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3d582354-eed1-4dfd-94c1-31d6cfd9e85b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043216 Jul 29 06:34:41.787230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 549/1081] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:42.135574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:42.137758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:42.144312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:42.144795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:42.145567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:42.146003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:42.176217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9924b082-d4bb-4072-aa1c-d5fb87945c7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045240 Jul 29 06:34:42.176433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:42.176928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 533/1082] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:42.177035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:42.184074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:42.184531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:42.185318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:42.185759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:42.318294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:42.326312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ffdcc177-243f-45aa-b527-25f6342cadfc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153854 Jul 29 06:34:42.326862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 550/1083] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:34:42.799423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:42.801663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:42.808232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:42.808713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:42.809476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:42.809914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:42.839332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-278947d5-db1d-446d-9a55-60e98bc3d419 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043878 Jul 29 06:34:42.839879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 534/1084] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:43.188525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:43.190647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:43.197284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:43.197761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:43.198526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:43.198964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:43.228448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e73f073d-35e3-47d0-ada2-25bbb4867835 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043348 Jul 29 06:34:43.229016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 551/1085] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:43.347160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:43.347768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:43.354950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:43.355396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:43.356149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:43.356605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:43.484569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:43.492117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4322eb58-08f2-4bbf-bc78-90bdf2e8e807 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148821 Jul 29 06:34:43.493510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 535/1086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:43.851805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:43.854895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:43.860948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:43.861408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:43.862181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:43.862630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:43.892103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dc49638c-c93f-4e5d-818f-2a6449fd467f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044354 Jul 29 06:34:43.892678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 552/1087] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:44.240206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:44.242371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:44.249081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:44.249528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:44.250280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:44.250713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:44.279450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82862caf-0608-4992-8712-2f6e9bf1a2c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043215 Jul 29 06:34:44.279993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 536/1088] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:44.514615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:44.515179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:44.521632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:44.522081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:44.522924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:44.523384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:44.651627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:44.659016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d622ff8b-4edb-4610-a1aa-204c2b28d1b6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148314 Jul 29 06:34:44.659568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 553/1089] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:44.905057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:44.907205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:44.913686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:44.914133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:44.914898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:44.916119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:44.944436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bf67c7f2-0f37-49c9-bb7b-223153b0a18b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043514 Jul 29 06:34:44.945008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 537/1090] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:45.293479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:45.295676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:45.302296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:45.302745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:45.303517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:45.303986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:45.342598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0987af92-c86d-42f2-b89b-611b7ad39a43 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054085 Jul 29 06:34:45.343568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 554/1091] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:45.679693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:45.681224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:45.687514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:45.687977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:45.688784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:45.689230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:45.691835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:45.822900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:45.830252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c389ccb-c509-4006-b7db-31b0847d20b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154440 Jul 29 06:34:45.830806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 538/1092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:45.957094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:45.959182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:45.966805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:45.967259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:45.968022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:45.968461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:45.997368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6302057d-69ac-49a4-a776-f4a631872cd5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044548 Jul 29 06:34:45.997900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 555/1093] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:46.358293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:46.360502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:46.366911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:46.367358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:46.368118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:46.368566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:46.396280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-976bcf43-5168-43c3-9f67-fee55c86d514 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041995 Jul 29 06:34:46.396861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 539/1094] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:46.852277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:46.853030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:46.858995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:46.859446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:46.860202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:46.860672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:46.994161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:47.001385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3d8da082-ef9a-44b0-862b-8cff03c6dd16 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153064 Jul 29 06:34:47.001948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 556/1095] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:47.010345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:47.012561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:47.018542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:47.018985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:47.019746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:47.020177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:47.048737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e5972087-142f-4a73-92d0-5edc1dd61afa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043068 Jul 29 06:34:47.049284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 540/1096] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:47.408979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:47.411186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:47.417793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:47.418246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:47.419009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:47.419447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:47.421799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:47.449920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-405655b3-f80c-481d-8a13-574ab1e1aca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Jul 29 06:34:47.450471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 557/1097] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:48.023289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:48.023866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:48.031192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:48.031643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:48.032407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:48.032878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:48.061702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:48.063957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:48.070622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:48.071084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:48.072485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:48.072955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:48.102722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a3295577-c83b-40c2-bf45-c0a153e3634b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045272 Jul 29 06:34:48.103292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 558/1098] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:48.164848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:48.172388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-26cc0217-4536-4386-bbf4-3f1205dedfb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153072 Jul 29 06:34:48.172992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 541/1099] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:48.462742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:48.464934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:48.470924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:48.471381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:48.472142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:48.472603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:48.503215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-28ea3127-f2d5-450f-b772-866801d49bd5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044844 Jul 29 06:34:48.503798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 559/1100] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:49.115367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:49.117570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:49.124490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:49.124978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:49.125755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:49.126198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:49.156112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-60b5bbd7-c4ad-4739-9e0d-1f6f983ee37a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044760 Jul 29 06:34:49.156694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 542/1101] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:49.193438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:49.194050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:49.201217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:49.201665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:49.202418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:49.202850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:49.338574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:49.345964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f5977337-d92f-454d-a56a-de6d45a54c98 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156461 Jul 29 06:34:49.346520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 560/1102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:49.516031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:49.518255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:49.524301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:49.524886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:49.525637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:49.526085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:49.556814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-718120f7-09f6-4069-b835-e31fa562d246 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044747 Jul 29 06:34:49.557373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 543/1103] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:50.169411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:50.171578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:50.177562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:50.178021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:50.178783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:50.179226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:50.208353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-216f69e8-fa55-4d11-a071-6270786b323f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043749 Jul 29 06:34:50.208971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 561/1104] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:50.367114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:50.367730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:50.374943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:50.375377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:50.376141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:50.376597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:50.508884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:50.516499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dda4ef3c-7116-4fe5-81cc-c3d1bc6ae748 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153229 Jul 29 06:34:50.517096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 544/1105] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:50.568968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:50.571284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:50.577479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:50.577932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:50.578692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:50.579129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:50.609183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0add91cc-f99e-4ca4-a7b6-7e2c4809203a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044216 Jul 29 06:34:50.609729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 562/1106] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:51.227313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:51.230460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:51.236820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:51.237266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:51.238029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:51.238463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:51.268779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-18cd05f8-bb97-4aff-a13f-47d8513b73f4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045603 Jul 29 06:34:51.269324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 545/1107] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:51.537011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:51.537552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:51.545197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:51.545670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:51.546425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:51.546860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:51.621126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:51.623336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:51.629388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:51.629842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:51.630607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:51.631041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:51.661512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f1e37f1c-c45f-4950-a2fe-35cef02c45a0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044292 Jul 29 06:34:51.662478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 546/1108] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:34:51.682081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:51.689448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9a54c214-ef5b-4e95-9c75-a1d5cf958566 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156556 Jul 29 06:34:51.690006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 563/1109] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:52.281016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:52.283150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:52.289541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:52.290070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:52.291094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:52.291535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:52.320958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e8f9084f-4cb9-4a83-b65d-e1ce49731121 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043951 Jul 29 06:34:52.322515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 547/1110] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:52.674463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:52.676694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:52.683855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:52.684312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:52.685114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:52.685560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:52.710544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:52.711398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:52.715080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-69ebdf82-6dd6-4c5f-bfb9-e44cdcfd8a57 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044556 Jul 29 06:34:52.715651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 564/1111] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:52.717704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:52.718169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:52.718950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:52.719388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:52.848915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:52.857418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-996080b6-ac41-40b8-a59b-51786378f449 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150986 Jul 29 06:34:52.857980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 548/1112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:34:53.334142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:53.336317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:53.342364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:53.342823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:53.343588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:53.344029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:53.373879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0b3c728e-da53-407d-b637-07a90337ce06 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043998 Jul 29 06:34:53.374425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 565/1113] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:53.726903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:53.729752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:53.736211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:53.736770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:53.737534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:53.737967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:53.766500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-40b26f5a-b714-40f3-ad9b-770275069f2c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043632 Jul 29 06:34:53.767524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 549/1114] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:53.879506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:53.880119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:53.886467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:53.886919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:53.887684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:53.888119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:54.017929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:54.025336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2c51e4aa-d849-4339-a08b-7eeb915ea5ed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149694 Jul 29 06:34:54.025901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 566/1115] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:54.386394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:54.388563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:54.394587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:54.395043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:54.395812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:54.396274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:54.425794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87866da2-26c9-4db3-a0a7-3a3184ec38b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043470 Jul 29 06:34:54.426335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 550/1116] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:54.779742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:54.781910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:54.787936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:54.788388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:54.789189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:54.789623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:54.818309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c79b3204-0929-4914-9256-4e5617b48747 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042524 Jul 29 06:34:54.818851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 567/1117] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:55.046136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:55.046670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:55.053149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:55.053598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:55.054351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:55.054785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:55.184724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:55.192144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d881fc8e-bcb1-4413-aac5-555946b7ed5e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149955 Jul 29 06:34:55.192732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 551/1118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:55.439054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:55.441248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:55.449009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:55.449466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:55.450228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:55.450664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:55.479791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e8fa4dee-689f-4c04-80a2-fa83c48c6ed4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044749 Jul 29 06:34:55.480345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 568/1119] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:55.831148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:55.833624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:55.839757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:55.840193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:55.840996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:55.841431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:55.870415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6f44971f-ba33-4caa-a1f9-af3caa60b0f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043326 Jul 29 06:34:55.870960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 552/1120] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:56.214048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:56.214660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:56.220565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:56.221022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:56.221768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:56.222200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:56.356318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:56.363798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-97a56e61-4d80-49f9-8a00-ae7751b4bcf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154355 Jul 29 06:34:56.364393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 569/1121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:56.492140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:56.494763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:56.501751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:56.502197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:56.502990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:56.503420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:56.533936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10f41d17-249f-4f56-8985-343e7051b79f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045812 Jul 29 06:34:56.534475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 553/1122] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:56.882629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:56.885455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:56.891760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:56.892208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:56.892988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:56.893422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:56.921316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7f643fc6-bf9a-4447-9d66-80ecf76f22e6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042690 Jul 29 06:34:56.921846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 570/1123] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:57.383913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:57.384527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:57.390551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:57.390998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:57.391757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:57.392193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:57.526000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:57.528197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:57.534749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d7bab05-045c-4638-91dc-7f7ef141c6d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154794 Jul 29 06:34:57.535314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 554/1124] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:57.547142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:57.549307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:57.555434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:57.556081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:57.556893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:57.557338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:57.585855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5db78809-eb91-4be6-92b0-607c97a0846d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042883 Jul 29 06:34:57.586400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 571/1125] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:57.934136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:57.937625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:57.943601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:57.944053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:57.944852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:57.945292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:57.974679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ff9bc54f-90ba-4516-abda-6d6692daf895 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Jul 29 06:34:57.975212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 555/1126] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:58.557206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:58.557879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:58.560200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=86 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:58.565555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:58.566004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:58.566756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:58.567189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:58.598832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:58.601001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:58.608277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:58.608767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:58.609547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:58.609987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:58.640115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10c1b609-96bd-4cc4-94af-f07b83614aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045166 Jul 29 06:34:58.640704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 556/1127] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:34:58.697004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:58.704412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e693b3db-0426-4163-bd17-d0a31a11b02b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151889 Jul 29 06:34:58.705001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 572/1128] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:34:58.987189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:58.989356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:58.995696 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:58.996159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:58.996960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:58.997404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:59.026133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3de16ee4-3678-4e16-b8c1-9e1492a1d07e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042909 Jul 29 06:34:59.026677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 557/1129] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:34:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:34:59.652611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:59.654747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:59.661239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:59.661690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:59.662454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:59.662890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:59.687858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:59.692982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b423055-8716-4b1b-ab1c-dce764efd4c5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044503 Jul 29 06:34:59.693528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 573/1130] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:34:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:34:59.726069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:34:59.726701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:34:59.729817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=82 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:34:59.735358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:59.735805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:59.736597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:34:59.737036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:34:59.866222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:34:59.874382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f767d8ae-dbca-4d6a-9b84-0a02fb34176b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152229 Jul 29 06:34:59.874949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 558/1131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:34:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:00.038483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:00.040845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:00.046669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:00.047119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:00.047872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:00.048304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:00.077608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cbfe114b-2d0c-4768-8d71-7e2202d13dac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Jul 29 06:35:00.078145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 574/1132] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:00.705544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:00.707963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:00.714212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:00.714647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:00.715397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:00.715830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:00.745443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f8eda0ed-e16d-4b08-ac35-a1e198bfa40e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043827 Jul 29 06:35:00.746034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 559/1133] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:00.895253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:00.895873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:00.902414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:00.902865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:00.903633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:00.904068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:01.031544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:01.038993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-177c6837-bcbb-4488-ae71-434ccb574a29 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147640 Jul 29 06:35:01.040075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 575/1134] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:01.090078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:01.092260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:01.098260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:01.098715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:01.099475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:01.099916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:01.129810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06cc52b4-e8bd-43f7-8faa-7d49c9f4ea8d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043883 Jul 29 06:35:01.130385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 560/1135] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:01.757310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:01.759900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:01.765915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:01.766365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:01.767122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:01.767560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:01.798168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b612261-a939-4ffa-b59f-b8ce9cedd966 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044798 Jul 29 06:35:01.798717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 576/1136] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:02.060967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:02.061500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:02.067908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:02.068358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:02.069154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:02.069592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:02.141418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:02.143584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:02.150906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:02.151459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:02.152180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:02.152658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:02.182499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-15020b7a-8921-4229-bd16-03d2e5ad1c05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045042 Jul 29 06:35:02.183053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 577/1137] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:02.203085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:02.210921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7fa51c4b-699c-4399-99ba-936a37bae30f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154021 Jul 29 06:35:02.212048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 561/1138] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:02.810559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:02.812716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:02.818784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:02.819234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:02.819989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:02.820424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:02.849199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9b472135-8072-477e-a818-b2ee417b087e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042626 Jul 29 06:35:02.849742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 578/1139] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:03.194698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:03.197450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:03.203874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:03.204318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:03.205117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:03.205554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:03.233010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:03.233624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:03.234290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3de42dd4-5f32-44ab-bbbd-5a6eabc0ca1d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Jul 29 06:35:03.234843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 562/1140] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:03.240143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:03.240653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:03.241411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:03.241918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:03.373206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:03.380615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-63175179-a5ff-47c8-8de1-d867cdd16c49 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151390 Jul 29 06:35:03.381206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 579/1141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:35:03.862278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:03.864466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:03.871168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:03.871611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:03.872367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:03.872836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:03.901930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d7f2596f-896e-4c8b-96e1-32b404b10e50 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043606 Jul 29 06:35:03.902464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 563/1142] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:04.246269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:04.248439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:04.254986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:04.255439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:04.256200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:04.256668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:04.285106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-83ec1ff9-8c19-42c1-ac41-635a7e520730 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042962 Jul 29 06:35:04.285651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 580/1143] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:04.403070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:04.403681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:04.410124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:04.410567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:04.411329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:04.411764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:04.541065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:04.548632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0f11783e-15d1-446e-8d0b-d5f6489bbad4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150111 Jul 29 06:35:04.549194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 564/1144] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:04.914755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:04.917104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:04.923109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:04.923570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:04.924332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:04.924806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:04.953520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f013c647-bd95-4200-bc31-e4317cc329c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043253 Jul 29 06:35:04.954073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 581/1145] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:05.298171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:05.300276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:05.306335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:05.306788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:05.307554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:05.307998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:05.337432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-70480c92-284e-44e7-9602-644998165631 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043244 Jul 29 06:35:05.337977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 565/1146] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:05.569784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:05.570319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:05.577420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:05.577862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:05.578611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:05.579040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:05.707793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:05.715244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8d40ee0e-357c-4a0b-91b5-e04201b622e0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149372 Jul 29 06:35:05.715797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 582/1147] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:05.966860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:05.969028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:05.975409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:05.975853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:05.976633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:05.977972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:06.005704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aea65dd3-80c5-446a-b6ad-2cf864078d5c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042896 Jul 29 06:35:06.006237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 566/1148] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:06.350206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:06.352483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:06.358515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:06.358972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:06.359737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:06.360180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:06.388935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1013d00c-3690-46a0-9848-b05a2c6c4bb9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042746 Jul 29 06:35:06.389478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 583/1149] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:06.735164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:06.735778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:06.741937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:06.742433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:06.743204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:06.743637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:06.876892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:06.884843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e1e38dc4-3376-4ff0-96c5-8f4d8ee4bcc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153502 Jul 29 06:35:06.885412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 567/1150] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:07.018546 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:07.020678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:07.027284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:07.027745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:07.028506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:07.028971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:07.059385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e1301cf8-88b2-4d44-bb86-3e4cdddc44b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044576 Jul 29 06:35:07.059938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 584/1151] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:07.401014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:07.403148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:07.409586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:07.410035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:07.410792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:07.411226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:07.440467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f063ccf-469f-40cb-ae13-a31adb0c2d8a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Jul 29 06:35:07.441041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 568/1152] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:07.905849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:07.906469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:07.912510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:07.912994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:07.913761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:07.914210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:08.043362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:08.050848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4cd8e95d-64a9-4586-8cbf-646cbf913e56 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148894 Jul 29 06:35:08.051406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 585/1153] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:08.071959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:08.074120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:08.080084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:08.080620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:08.081695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:08.082133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:08.112708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-872bd933-a70b-4fc6-899f-5c6125192709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045312 Jul 29 06:35:08.113252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 569/1154] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:08.452790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:08.454952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:08.461767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:08.462228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:08.462986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:08.463410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:08.493790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-81e2e048-9fa8-4162-a367-66dcb92713f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Jul 29 06:35:08.494329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 586/1155] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:09.073414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:09.073951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:09.080414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:09.080895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:09.081920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:09.082360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:09.125784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:09.128047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:09.135068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:09.135518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:09.136287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:09.136876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:09.167288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-556ffe68-961e-49bf-9504-b44cd2769615 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045441 Jul 29 06:35:09.167859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 587/1156] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:09.221966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:09.232056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-40db0e15-12e7-43c8-bcc8-7b120f94ecc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.163439 Jul 29 06:35:09.232692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 570/1157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:09.505860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:09.508276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:09.514211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:09.514655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:09.515404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:09.515838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:09.545187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e1ef2abc-2706-4059-aa0e-4a4da49617ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043253 Jul 29 06:35:09.545733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 588/1158] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:10.180321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:10.182844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:10.189537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:10.189994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:10.190763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:10.191205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:10.204710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:10.221172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d5170330-d5d9-4d31-ac78-b0c1715e082a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045476 Jul 29 06:35:10.221723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 571/1159] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:10.260751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:10.261374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:10.267841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:10.268291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:10.269085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:10.269523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:10.398388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:10.406401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b3de6fd-8b09-4615-8185-a494b99ebb63 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149577 Jul 29 06:35:10.406967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 589/1160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:10.557490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:10.559739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:10.565754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:10.566200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:10.566971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:10.567408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:10.598260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-65608e5f-220a-49db-814f-4688ac623fec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Jul 29 06:35:10.598808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 572/1161] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:11.234402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:11.236565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:11.243665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:11.244117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:11.244923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:11.245360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:11.260156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:11.277020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-92396244-6362-4a56-8c24-859fcc243381 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046542 Jul 29 06:35:11.278426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 590/1162] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:11.427464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:11.428082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:11.435638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:11.436094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:11.436908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:11.437350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:11.571155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:11.578908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b44e4fa0-a410-4a24-9f8f-db111ff5413a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155659 Jul 29 06:35:11.579473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 573/1163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:11.610493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:11.612803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:11.618895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:11.619340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:11.620090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:11.620522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:11.649657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a37de300-e73f-44a9-bf95-e58489bfee95 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042185 Jul 29 06:35:11.650200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 591/1164] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:12.290236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:12.292606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:12.298839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:12.299286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:12.300056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:12.300484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:12.331295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-53433ddd-2598-45c4-9885-c81ea7712487 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045664 Jul 29 06:35:12.332347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 574/1165] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:12.602285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:12.603573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:12.609716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:12.610163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:12.610924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:12.611354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:12.662215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:12.665047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:12.672983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:12.673439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:12.674221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:12.674659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:12.706718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-457eae4e-f1e8-48e1-a679-3b66d71f750b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048359 Jul 29 06:35:12.707304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 575/1166] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:12.751733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:12.760149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-20f37ffa-4548-417f-857d-2b6e9afb4d21 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.162459 Jul 29 06:35:12.760747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 592/1167] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:12.814306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:35:12.814498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:35:13.346012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:13.349584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:13.356746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:13.357199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:13.357967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:13.358406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:13.387716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1e57c65-c212-4219-a0c7-d998a9dad633 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046721 Jul 29 06:35:13.388277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 576/1168] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:13.719875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:13.721979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:13.728802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:13.729259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:13.730049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:13.730473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:13.760552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-af82a94b-a919-4dc8-912d-d19dc033cc0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044787 Jul 29 06:35:13.761120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 593/1169] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:13.780858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:13.781473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:13.788322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:13.788797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:13.789629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:13.790057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:13.923108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:13.932022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bb6e9e19-f7c7-4752-bdd3-57d5e5160568 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154925 Jul 29 06:35:13.932606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 577/1170] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:14.400456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:14.402601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:14.408918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:14.409383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:14.410155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:14.410607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:14.440251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d404244-fb3a-4e6d-9f52-d4f02b2ab82a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043884 Jul 29 06:35:14.440859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 594/1171] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:14.772841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:14.775052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:14.781040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:14.781634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:14.782237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:14.782670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:14.813136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f6cc4138-5365-410b-af69-745e23adc584 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044272 Jul 29 06:35:14.813674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 578/1172] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:14.952931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:14.953536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:14.960278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:14.960813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:14.961570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:14.961999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:15.095530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:15.103481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a8f890bf-30fe-436b-84fc-e944f50b4f55 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154333 Jul 29 06:35:15.104031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 595/1173] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:15.452351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:15.454909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:15.460934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:15.461387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:15.462150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:15.462580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:15.490805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c41c911d-556f-431c-b691-e4a077aa88aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042395 Jul 29 06:35:15.491347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 579/1174] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:15.825178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:15.827326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:15.833573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:15.834025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:15.834788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:15.835226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:15.863923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7d358a73-b810-4bba-9615-a7f1e1d1b5d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042689 Jul 29 06:35:15.864465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 596/1175] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:16.124149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:16.124807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:16.131222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:16.131664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:16.132414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:16.132984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:16.259186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:16.266700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-13dd8615-5734-45d5-b6cf-7082cdadd04d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146381 Jul 29 06:35:16.267258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 580/1176] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:16.503935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:16.506051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:16.512978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:16.513423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:16.514185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:16.514615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:16.545452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2b824c33-1e3e-4018-b055-3fe9707a5e5b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045632 Jul 29 06:35:16.546016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 597/1177] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:16.876798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:16.878941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:16.885251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:16.885699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:16.886456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:16.886887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:16.916626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5be6c3be-2abe-4fd7-aa1d-41c10aafa4d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Jul 29 06:35:16.917164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 581/1178] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:17.288324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:17.289642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:17.295657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:17.296116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:17.296917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:17.297357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:17.427314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:17.434969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-48104a21-390b-4a4b-9f2f-eb92fd5b4327 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150576 Jul 29 06:35:17.435530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 598/1179] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:17.558050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:17.560142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:17.566644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:17.567086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:17.567839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:17.568318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:17.597587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e53270a9-ff10-4865-8914-3a62d38e5ba3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043724 Jul 29 06:35:17.598126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 582/1180] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:17.928861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:17.932011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:17.938501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:17.938950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:17.939710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:17.940144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:17.969919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac7de424-b268-4bac-887c-fa48f341bd26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045110 Jul 29 06:35:17.970457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 599/1181] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:18.456783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:18.457420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:18.463940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:18.464382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:18.465170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:18.465603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:18.555901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:35:18.556053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:35:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 (ip 10.222.0.33) !!! Jul 29 06:35:18.600128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:18.608417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1a559db6-b086-4c79-b2bb-c0af5a218b80 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155906 Jul 29 06:35:18.609172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 583/1182] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:18.609832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:18.612002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:18.617946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:18.618397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:18.619163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:18.619604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:18.647569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-75e807fa-4550-430e-bc2a-172f584996c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041645 Jul 29 06:35:18.648749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 600/1183] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:18.981872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:18.984058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:18.990013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:18.990461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:18.991221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:18.991653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:19.020068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d398f026-4f10-4be7-bd99-988763649831 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Jul 29 06:35:19.020607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 584/1184] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:19.571327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:35:19.571841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:35:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:35:19.628416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:19.629055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:19.635632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:19.636017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:19.636804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:19.637245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:19.660177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:19.662358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:19.669919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:19.670380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:19.671468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:19.672336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:19.706899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1a999f6a-fb84-496d-8bd8-1b3c850c7b26 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050277 Jul 29 06:35:19.707470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 585/1185] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:19.770909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:19.778560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bb42b3db-5756-4b11-a7c0-efb3d0a75eae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153866 Jul 29 06:35:19.779119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 601/1186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:20.032989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:20.035101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:20.041891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:20.042349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:20.043118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:20.043563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:20.072223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a50ee355-b74d-4ff8-85b2-d06fcbd9c33d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 Jul 29 06:35:20.072803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 586/1187] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:20.719470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:20.721662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:20.729050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:20.729506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:20.730280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:20.730744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:20.761019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6aaf9010-4057-4092-90f0-a833020f6f07 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045516 Jul 29 06:35:20.761566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 602/1188] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:20.799555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:20.800174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:20.807362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:20.807811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:20.808658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:20.809099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:20.937136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:20.944636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ff075f24-8543-4690-874e-2d4e19f290fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148903 Jul 29 06:35:20.945900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 587/1189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:21.084571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:21.087037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:21.092993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:21.093448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:21.094212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:21.094654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:21.124295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-35257430-fcf9-4322-8e1d-dc6c054133e2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Jul 29 06:35:21.124874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 603/1190] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:21.774383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:21.776587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:21.782620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:21.783073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:21.783841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:21.784281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:21.786664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:21.815615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eb62ef94-ddc4-45dc-8f70-87c6a27fb0b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045912 Jul 29 06:35:21.816227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 588/1191] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:21.967736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:21.968354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:21.974827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:21.975274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:21.976039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:21.976564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:22.102574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:22.109946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9e03250-80b6-41ed-8e1d-4abcc597c8e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146087 Jul 29 06:35:22.110497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 604/1192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:22.137210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:22.139371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:22.145675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:22.146133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:22.146904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:22.147350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:22.176803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ada6173c-5271-4972-aa21-ebf7af9d9053 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Jul 29 06:35:22.177343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 589/1193] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:22.828807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:22.830906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:22.837493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:22.837956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:22.838741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:22.839179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:22.870456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-71cb5be3-8654-4c63-bfae-9a70f8ac8adf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Jul 29 06:35:22.871001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 605/1194] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:23.131298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:23.131911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:23.138688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:23.139137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:23.139905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:23.140342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:23.189514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:23.191694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:23.198096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:23.198539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:23.199296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:23.199723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:23.230989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2574fa9d-9e16-4583-8ab1-d90854f2a470 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Jul 29 06:35:23.231768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 606/1195] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:23.269703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:23.277909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ef91e98-aaa0-4a57-ae5b-90b48cfc2431 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150501 Jul 29 06:35:23.278456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 590/1196] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:23.883159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:23.885322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:23.891490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:23.891946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:23.892735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:23.893177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:23.895480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:23.923356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6363ddcd-2ea2-4294-9b73-a058c659e389 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044396 Jul 29 06:35:23.923892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 607/1197] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:24.244199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:24.246381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:24.252813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:24.253257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:24.254012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:24.254446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:24.283655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-da1fdf7c-f04b-45c2-b56d-afbf4389a8d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Jul 29 06:35:24.284191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 591/1198] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:24.299282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:24.299898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:24.306518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:24.306968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:24.307723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:24.308154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:24.440416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:24.449222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-48b5ebbb-49c0-44ba-b0cb-3adbb4b0bbe2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152677 Jul 29 06:35:24.450159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 608/1199] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:24.935673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:24.937850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:24.943874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:24.944334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:24.945129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:24.946108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:24.975201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-352039ad-725a-4612-9a38-da6f0086f7d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043563 Jul 29 06:35:24.975745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 592/1200] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:25.296346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:25.298523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:25.305528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:25.306135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:25.306737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:25.307177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:25.336304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d53ad5e6-285a-4944-8468-de5afceeaaf9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Jul 29 06:35:25.336999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 609/1201] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:25.471545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:25.472166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:25.478978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:25.479431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:25.480195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:25.480664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:25.613216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:25.621539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cf3b5413-2755-468b-a558-e9aa571bc5c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153850 Jul 29 06:35:25.622104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 593/1202] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:25.987510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:25.989664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:25.995765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:25.996213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:25.997003 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:25.997433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:26.025895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e1f1d469-381c-4fa0-a589-fbd091eda210 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042375 Jul 29 06:35:26.026439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 610/1203] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:26.348741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:26.351020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:26.357257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:26.357712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:26.358481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:26.358917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:26.387613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-32cd6858-a50f-4428-bb0a-2427ba6d326c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043140 Jul 29 06:35:26.388155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 594/1204] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:26.642300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:26.642844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:26.649910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:26.650369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:26.651131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:26.651571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:26.782451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:26.789983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-08bf8029-90d5-4755-a4b2-1d985964c3d6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151599 Jul 29 06:35:26.790545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 611/1205] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:27.038390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:27.041138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:27.047558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:27.048003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:27.048786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:27.049327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:27.078144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-69b2e3a1-483a-453a-b89f-1c1103c25ea6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043906 Jul 29 06:35:27.078683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 595/1206] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:27.400391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:27.402568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:27.408650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:27.409119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:27.409889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:27.410333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:27.439116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f4ab2653-6e24-4ee0-8d33-4970b83af7a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043321 Jul 29 06:35:27.439660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 612/1207] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:27.811180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:27.811792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:27.817836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:27.818348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:27.819111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:27.819548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:27.945973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:27.953622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c94ec946-07dd-4de6-9462-808484ed4f6f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146240 Jul 29 06:35:27.954177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 596/1208] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:28.090777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:28.093579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:28.100020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:28.100468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:28.101249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:28.101724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:28.130114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-02da1813-9e78-4110-b15f-d6acb0b26c29 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043300 Jul 29 06:35:28.130658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 613/1209] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:28.452431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:28.454522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:28.461508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:28.461959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:28.462720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:28.463151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:28.491691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6facd5c3-e4e0-4899-8dcc-51e81ed9c869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043440 Jul 29 06:35:28.492952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 597/1210] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:28.975856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:28.977611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:28.980595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:28.986047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:28.986443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:28.987205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:28.987642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:29.114602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:29.123066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-84882e8e-ffdb-494e-9ae0-d8e3124aac88 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151736 Jul 29 06:35:29.123625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 614/1211] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:29.143463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:29.145692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:29.152115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:29.152607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:29.153382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:29.153826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:29.182606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c3fa5e6d-7505-4242-bcb5-4b6f0ad8c2ec tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043108 Jul 29 06:35:29.183153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 598/1212] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:29.504745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:29.506880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:29.513015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:29.513464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:29.514219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:29.514649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:29.543437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-36e04cd2-2d27-439c-995a-895287ce78db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042809 Jul 29 06:35:29.543972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 615/1213] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:30.145956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:30.146572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:30.149784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=82 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:30.155024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:30.155475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:30.156238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:30.156702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:30.194981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:30.197923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:30.204379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:30.204860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:30.205646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:30.206076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:30.236256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-49151c3f-5b75-4216-b8d7-35c38ad091cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045180 Jul 29 06:35:30.236910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 616/1214] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:30.291412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:30.298856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-14bb263d-d272-4ce0-a4b5-ddcb3329b2a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156832 Jul 29 06:35:30.299414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 599/1215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:30.555838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:30.557951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:30.563898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:30.564355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:30.565152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:30.565588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:30.594849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1ea4d1ca-5731-4746-822b-0575ea873619 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Jul 29 06:35:30.595382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 617/1216] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:31.249073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:31.251255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:31.258409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:31.258860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:31.259615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:31.260047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:31.288662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7429b22c-c536-4bf7-8e38-6eecae061641 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043559 Jul 29 06:35:31.289449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 600/1217] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:31.321184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:31.321826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:31.328211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:31.328693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:31.329444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:31.329876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:31.461376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:31.468874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2cdcbb47-4061-4297-b9d9-67d9ba84b47f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152136 Jul 29 06:35:31.469366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 618/1218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:31.607926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:31.610109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:31.616171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:31.616665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:31.618152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:31.618595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:31.648120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-717518c4-b234-40a2-9a5d-fb821fc71171 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Jul 29 06:35:31.648648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 601/1219] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:32.300693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:32.302887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:32.309040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:32.309494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:32.310255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:32.310693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:32.340942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-57af87e5-cb3d-4e73-a965-81d33c7e49a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044297 Jul 29 06:35:32.342086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 619/1220] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:32.489431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:32.490054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:32.496675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:32.497131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:32.497900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:32.498377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:32.627114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:32.635132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e550f15e-d01e-453b-a408-ae0161caf2f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149554 Jul 29 06:35:32.635697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 602/1221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:32.659913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:32.662086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:32.668111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:32.668579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:32.669336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:32.669768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:32.699966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1ed16f67-dcd9-4c15-8e20-ab66ac5bed65 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Jul 29 06:35:32.700524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 620/1222] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:33.354059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:33.356202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:33.362169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:33.362612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:33.363364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:33.363791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:33.392061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45ec97e1-8962-478d-99bc-302d54bfb0ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042641 Jul 29 06:35:33.392619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 603/1223] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:33.656980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:33.657524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:33.664831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:33.665360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:33.666124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:33.666564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:33.712619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:33.714800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:33.721878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:33.722404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:33.723508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:33.723957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:33.755095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:33.760307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5afec609-f43d-417e-96fe-c8962fd2664f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052408 Jul 29 06:35:33.760898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 604/1224] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:33.800371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:33.807771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5cbeaddb-6548-4600-ba2b-ea3156b617fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154730 Jul 29 06:35:33.808318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 621/1225] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:34.404782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:34.406944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:34.413107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:34.413497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:34.414429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:34.414864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:34.443536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-31702cd8-8d6c-49d3-be20-c4c8bf2f3ce1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042822 Jul 29 06:35:34.444071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 605/1226] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:34.772452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:34.775239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:34.781742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:34.782187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:34.782939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:34.783372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:34.811117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f7e8045-a625-41c1-a286-cfbaf435b6ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042583 Jul 29 06:35:34.811658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 622/1227] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:34.828877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:34.829500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:34.836930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:34.837388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:34.838152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:34.838594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:34.968470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:34.976004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-23b734d4-7b32-4d15-97d2-6a047657a9af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151020 Jul 29 06:35:34.976756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 606/1228] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:35.456881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:35.459054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:35.465930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:35.466382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:35.467258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:35.467573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:35.492745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:35.497979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7cfc3710-2168-46eb-afa5-e35a8e32361a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045424 Jul 29 06:35:35.498534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 623/1229] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:35.823610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:35.825778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:35.832039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:35.832634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:35.833264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:35.833701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:35.863256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6060e1b4-abab-4e15-80b0-5ede49aa2fff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043841 Jul 29 06:35:35.863797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 607/1230] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:35.997068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:35.997615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:36.004244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:36.004744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:36.005517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:36.005960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:36.136901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:36.144385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c7d5f6e-53c9-4448-8142-8d4a0a1f9222 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151311 Jul 29 06:35:36.144982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 624/1231] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:35:36.510395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:36.512578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:36.518581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:36.519028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:36.519790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:36.520224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:36.549320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-204be553-251d-4123-928f-63cbef2d2dbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043593 Jul 29 06:35:36.549871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 608/1232] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:36.875450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:36.877631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:36.883771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:36.884228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:36.885026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:36.885482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:36.915181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e439437a-b9e7-4873-b955-8850578daa79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043712 Jul 29 06:35:36.915721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 625/1233] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:37.167013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:37.167626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:37.174170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:37.174624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:37.175389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:37.175828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:37.303418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:37.311239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-598b3ceb-706c-4aac-bb59-747f2cd896b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149120 Jul 29 06:35:37.311797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 609/1234] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:37.561454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:37.563889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:37.570994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:37.571440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:37.572202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:37.572677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:37.602794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-451df3fe-7969-4892-964a-e2dd1a927b8e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045243 Jul 29 06:35:37.603332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 626/1235] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:37.927332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:37.930434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:37.936432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:37.936913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:37.937677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:37.938115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:37.970188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-47c21686-bfb4-40b1-9650-904dd434304f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046807 Jul 29 06:35:37.970737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 610/1236] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:38.331227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:38.332095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:38.338275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:38.338720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:38.339502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:38.339936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:38.472140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:38.479943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b166a03-16e5-4b58-bce0-b4f3ba24f752 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152599 Jul 29 06:35:38.480516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 627/1237] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:38.615157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:38.617827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:38.624240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:38.624729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:38.625493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:38.625933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:38.656057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-144a059b-14e1-4e52-a653-b96f1c4e73aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044889 Jul 29 06:35:38.656630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 611/1238] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:38.982753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:38.984946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:38.991320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:38.992312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:38.993090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:38.993520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:39.021714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7e566b10-0609-43d7-aa76-32d40e0be74b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043018 Jul 29 06:35:39.022244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 628/1239] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:39.500135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:39.500774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:39.506811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:39.507584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:39.508220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:39.508681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:39.668498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:39.670649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:39.676655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:39.677105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:39.677866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:39.678297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:39.708419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8e480baa-800a-45ea-8557-a0bf97572274 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043870 Jul 29 06:35:39.708999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 629/1240] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:39.716831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:39.724686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-572a7ce0-db7e-467c-bc77-2c2d2e2626cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.228211 Jul 29 06:35:39.725258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 612/1241] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:40.034367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:40.036435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:40.043160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:40.043610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:40.044377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:40.044841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:40.073459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7490c54-4199-402a-8130-38abadc797b3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043171 Jul 29 06:35:40.073997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 630/1242] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:40.721006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:40.723190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:40.730489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:40.730967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:40.731735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:40.732194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:40.746976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:40.747588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:40.753472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:40.753921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:40.754672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:40.755104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:40.766948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6757b627-93d5-40ee-b369-d1ca257d3dee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049925 Jul 29 06:35:40.767519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 613/1243] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:40.884891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:40.892247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9efaa720-5b4f-441a-8f28-1fb7135d4c65 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149045 Jul 29 06:35:40.892830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 631/1244] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:35:41.085982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:41.088143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:41.094088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:41.094540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:41.095300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:41.095734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:41.124509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-35acde4c-045b-401f-b529-1e28f0d2feca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042501 Jul 29 06:35:41.125076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 614/1245] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:41.779790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:41.781960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:41.788881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:41.789483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:41.790258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:41.790695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:41.819391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-91c55213-5c5d-4239-ac4c-0cbb5cbe6279 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043823 Jul 29 06:35:41.820854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 632/1246] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:41.914521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:41.915138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:41.921678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:41.922118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:41.922870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:41.923300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:42.056022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:42.063520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-452d8ac3-0151-47a6-bac5-650980e9ad84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153099 Jul 29 06:35:42.064078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 615/1247] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:42.136186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:42.138358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:42.144310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:42.144801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:42.145599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:42.146023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:42.174835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2f904626-5762-420b-8835-bc1295713490 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042844 Jul 29 06:35:42.175376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 633/1248] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:42.832119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:42.834310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:42.841128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:42.841582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:42.842351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:42.842795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:42.870694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c867ed0e-a327-443f-a19c-58e8f4bb35ea tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043057 Jul 29 06:35:42.871236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 616/1249] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:43.087044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:43.087657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:43.094137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:43.094584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:43.095344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:43.095781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:43.187237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:43.189448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:43.196513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:43.196990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:43.197764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:43.198741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:43.227228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b3567cfc-6f81-4313-954e-362b82d1ed6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043835 Jul 29 06:35:43.227801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 617/1250] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:43.232041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:43.239538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1bcca9cb-0fc1-47a7-90e0-11077d9a2022 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156907 Jul 29 06:35:43.240077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 634/1251] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:43.883717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:43.885938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:43.891934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:43.892375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:43.893170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:43.893611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:43.922244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2cb1494-4d70-4d96-8c0e-4dbd4ee5c5f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043061 Jul 29 06:35:43.922777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 618/1252] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:44.239401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:44.242112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:44.248586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:44.249040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:44.249800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:44.250237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:44.260698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:44.262687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:44.269120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:44.269569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:44.270337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:44.270771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:44.280012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0b103e72-7dd4-46ff-a0a3-6d023e55c0cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Jul 29 06:35:44.280592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 635/1253] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:44.397095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:44.404781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-edd913a7-0c55-4b73-90f1-b5b4520f5231 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147896 Jul 29 06:35:44.405341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 619/1254] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:35:44.934729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:44.936918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:44.942865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:44.943309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:44.944058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:44.944497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:44.973568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7edc2f22-a2f8-4101-8921-3ed8c5eac55d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042876 Jul 29 06:35:44.974099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 636/1255] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:45.292433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:45.294632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:45.301129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:45.301574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:45.302328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:45.302762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:45.332431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e1704cef-58e2-4553-ba40-8a41946d55ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044108 Jul 29 06:35:45.332997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 620/1256] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:45.426272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:45.426891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:45.433961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:45.434418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:45.435182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:45.435624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:45.564329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:45.572577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9f865c37-090d-49c8-94e6-5e405600aba2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150109 Jul 29 06:35:45.573141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 637/1257] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:45.986778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:45.988952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:45.995218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:45.995671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:45.996435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:45.996903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:46.010853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:46.026799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4280f7a5-b73e-48b6-9678-507c3cff4ddb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043988 Jul 29 06:35:46.027341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 621/1258] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:46.345371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:46.347545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:46.353717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:46.354089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:46.354869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:46.355334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:46.385225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b2a69184-f7f9-4ec7-899c-546eabcde384 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Jul 29 06:35:46.385791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 638/1259] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:46.593816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:46.594423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:46.601487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:46.601904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:46.602722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:46.603154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:46.736352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:46.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac49db38-5e05-4bb2-8f31-6cd56c0e2667 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154041 Jul 29 06:35:46.744530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 622/1260] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:47.038485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:47.040651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:47.047041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:47.047486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:47.048239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:47.048703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:47.078103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ab67398d-8883-4139-8fe1-0f69dbbab6d6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043714 Jul 29 06:35:47.078635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 639/1261] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:47.397525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:47.399699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:47.405700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:47.406148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:47.406905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:47.407361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:47.436260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ca72f55-097d-4d29-9c1f-80920f09e1f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042636 Jul 29 06:35:47.436828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 623/1262] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:47.765616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:47.766238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:47.773083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:47.773812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:47.774524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:47.774966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:47.791315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:47.908654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:47.916732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a9ca802a-982e-44b1-85c1-95d8f9557fd7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155042 Jul 29 06:35:47.917289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 640/1263] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:48.091243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:48.093408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:48.099762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:48.100207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:48.101216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:48.101649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:48.130343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4bd08b73-fc03-4bfd-a9ce-dc979bf65bee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042845 Jul 29 06:35:48.130875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 624/1264] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:48.449140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:48.451249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:48.458062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:48.458510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:48.459270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:48.459709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:48.488767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eda82a97-e56d-438a-bcb9-fc4a218472e8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044398 Jul 29 06:35:48.489330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 641/1265] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:48.937739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:48.938359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:48.944476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:48.944923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:48.945705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:48.946137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:49.072439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:49.080145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-735d21d1-fd66-41d4-b7e3-6e082bea1a9b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146332 Jul 29 06:35:49.080732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 625/1266] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:49.143525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:49.145668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:49.151551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:49.151993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:49.152772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:49.153207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:49.182808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-794d57e1-8477-4086-9e74-f3e9f3a6f31f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043197 Jul 29 06:35:49.183345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 642/1267] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:49.501466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:49.503700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:49.510159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:49.510609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:49.511369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:49.511809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:49.541783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d2b60baa-0e35-43d4-9c82-c1273d38952f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044266 Jul 29 06:35:49.542373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 626/1268] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:50.102346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:50.102970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:50.109486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:50.109942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:50.110717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:50.111157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:50.195391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:50.197585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:50.203795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:50.204240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:50.205036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:50.205471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:50.235473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c1d2703-8fa3-463a-a20a-4838afd22fd3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044300 Jul 29 06:35:50.236026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 627/1269] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:35:50.240212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:50.248170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6d731501-4dd2-4596-8eb8-ea87385a9f87 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150222 Jul 29 06:35:50.248813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 643/1270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:50.554831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:50.556996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:50.563425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:50.563879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:50.564675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:50.565119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:50.593852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fd901c0e-6b07-41ab-bf76-558222541b10 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043709 Jul 29 06:35:50.594495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 628/1271] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:51.248076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:51.250178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:51.256770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:51.257272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:51.258025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:51.258458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:51.269507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:51.270186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:51.276305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:51.276798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:51.277582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:51.278049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:51.287857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-910005a5-9c9e-4da2-bffa-f1a8c20249c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043790 Jul 29 06:35:51.289257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 644/1272] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:51.409291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:51.417439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-da511b7a-02ee-4504-8609-b35b24f30e07 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151978 Jul 29 06:35:51.418006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 629/1273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:35:51.606548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:51.608726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:51.614673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:51.615131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:51.615892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:51.616466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:51.644179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e8b657e9-f8c8-42c2-bb8f-6a0a51cdd9fc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041582 Jul 29 06:35:51.644749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 645/1274] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:52.300814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:52.303023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:52.310190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:52.310635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:52.311395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:52.311827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:52.340647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-adb7501d-01e4-49d8-9edc-696f858eb2b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043860 Jul 29 06:35:52.341195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 630/1275] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:52.439114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:52.439759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:52.446927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:52.447381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:52.448137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:52.448592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:52.580993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:52.589281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c3f65b60-9439-477e-bf3f-0208aafa25b3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154057 Jul 29 06:35:52.589844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 646/1276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:52.656833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:52.658976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:52.665004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:52.665512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:52.666246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:52.666654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:52.696231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7e6d98fd-776b-4abf-9701-e7a9e1f27cfc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043337 Jul 29 06:35:52.696806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 631/1277] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:53.352638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:53.354859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:53.360915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:53.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:53.362122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:53.362557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:53.390555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dc42caa6-5f30-4b4d-91ea-ab901aa9bd0d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042187 Jul 29 06:35:53.391091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 647/1278] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:53.610256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:53.610783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:53.617380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:53.617832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:53.618597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:53.619040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:53.709020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:53.711492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:53.717695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:53.718226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:53.719058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:53.719495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:53.748947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:53.749952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0bcade37-613d-4061-9a10-8974f24ccf27 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045356 Jul 29 06:35:53.750612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 648/1279] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:53.756488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-66cec8d2-f532-4e26-a5f8-f4391839e612 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150197 Jul 29 06:35:53.757652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 632/1280] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:54.403815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:54.406024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:54.411982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:54.412430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:54.414049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:54.414492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:54.443408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b34a7a70-9fc6-4174-9693-f87a11571aa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043926 Jul 29 06:35:54.443945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 649/1281] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:54.762091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:54.764249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:54.770821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:54.771267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:54.772064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:54.772586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:54.778262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:54.778884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:54.785291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:54.785751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:54.786526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:54.786971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:54.802409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c9ad8e0f-2cf2-4be2-975e-59f90314c32e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044281 Jul 29 06:35:54.802973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 633/1282] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:35:54.915482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:54.922961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-57b397ea-fcbe-465c-b1b7-f713c096776b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148518 Jul 29 06:35:54.923518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 650/1283] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:35:55.455849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:55.458307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:55.464531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:55.465007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:55.465778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:55.466220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:55.495604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fc110b60-ff1f-4c43-9218-8913e7e479a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043707 Jul 29 06:35:55.496159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 634/1284] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:55.815290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:55.817455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:55.823940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:55.824383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:55.825167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:55.825599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:55.854752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-130645f8-9ac7-482d-8876-01b7e01c12d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043380 Jul 29 06:35:55.855301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 651/1285] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:55.944749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:55.945445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:55.951901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:55.952355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:55.953156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:55.953599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:56.079575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:56.088085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8be56cb3-0458-453b-a4d0-9e47608a97bd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147466 Jul 29 06:35:56.088685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 635/1286] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:56.508173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:56.510394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:56.516418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:56.516905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:56.517674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:56.518115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:56.547023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cd5f1370-1060-4c71-84c3-dfe09c8abe00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043591 Jul 29 06:35:56.547573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 652/1287] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:56.867912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:56.870225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:56.876330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:56.876821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:56.877574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:56.878007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:56.906992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7d73e076-0073-4616-8052-252cca817ddc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043547 Jul 29 06:35:56.907557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 636/1288] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:57.109689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:57.110327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:57.117561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:57.118014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:57.118778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:57.119232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:57.247141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:57.254693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-873fad9d-e9ad-48e0-9d8c-4af06f3995e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148826 Jul 29 06:35:57.255256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 653/1289] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:57.559496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:57.561758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:57.568165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:57.568644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:57.569515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:57.569972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:57.598850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-118ad39d-c4e8-473d-b3d1-676c4a6b0a49 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043357 Jul 29 06:35:57.599393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 637/1290] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:57.919659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:57.921853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:57.927794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:57.928249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:57.929089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:57.929520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:57.957828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dab33734-0d65-4daf-97a9-cce2bd96fcaa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042103 Jul 29 06:35:57.958362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 654/1291] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:58.275412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:58.276023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:58.281979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:58.282423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:58.283229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:58.283679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:58.287504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:58.413886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:58.421637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4bacf3ec-be68-46df-9ad5-50e70b7eab47 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150218 Jul 29 06:35:58.423196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 638/1292] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:58.611392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:58.613601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:58.620808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:58.621259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:58.622023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:58.622463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:58.652306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c9a7e489-2e51-4b69-86da-870ce3427886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044914 Jul 29 06:35:58.652887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 655/1293] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:35:58.970923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:58.973005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:58.980063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:58.980514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:58.981305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:58.981738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:59.009816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f08fb90b-c3f0-4634-9259-393ed454ba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Jul 29 06:35:59.010353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 639/1294] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:35:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:35:59.445290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:59.445914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:59.447742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:35:59.453050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:59.453499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:59.454261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:59.454696 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:59.587943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:35:59.595528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2a660955-d214-479c-98f3-12703d4967e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154957 Jul 29 06:35:59.596085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 656/1295] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:35:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:35:59.664609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:35:59.666772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:35:59.672788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:59.673240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:59.674002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:35:59.674439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:35:59.704051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8bd0158e-6979-455d-b2c1-a9227b71a65e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043381 Jul 29 06:35:59.704527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 640/1296] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:35:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:00.022123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:00.024170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:00.030547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:00.030996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:00.031749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:00.032184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:00.034493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:00.062177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b0cee499-0311-470c-bebb-305adec05387 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Jul 29 06:36:00.062720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 657/1297] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:00.617071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:00.617666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:00.619978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:00.625734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:00.626187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:00.626991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:00.627428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:00.717378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:00.720137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:00.727487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:00.727950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:00.728768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:00.729211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:00.758865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c68c84ab-50ea-46fc-9272-05cb8bcdaee3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045382 Jul 29 06:36:00.759436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 658/1298] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:00.761263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:00.768778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a691d5d5-4ba8-4f05-92db-29a98279c892 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155791 Jul 29 06:36:00.769324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 641/1299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:01.075356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:01.077430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:01.084085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:01.084531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:01.086061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:01.086496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:01.114726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-21e19b24-c821-48bc-a94a-00699556295c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Jul 29 06:36:01.115263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 659/1300] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:01.771441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:01.774241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:01.780702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:01.781145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:01.781902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:01.782334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:01.790277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:01.790974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:01.796896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:01.797347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:01.798107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:01.798551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:01.812131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d1ecead-9ffb-42e1-8908-08308df267e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044717 Jul 29 06:36:01.812732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 642/1301] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:01.929698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:01.937392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-39fef3f6-56f0-475c-815a-a863e2e44260 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151073 Jul 29 06:36:01.937949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 660/1302] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:02.127163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:02.129348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:02.135385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:02.135841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:02.136630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:02.137076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:02.166249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fe2d6f3b-94df-492b-a453-d9adf288df4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Jul 29 06:36:02.166798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 643/1303] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:02.825724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:02.827788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:02.834600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:02.835186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:02.835956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:02.836398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:02.864935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7b760b92-10a7-4971-b8fc-34e59feddb54 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043227 Jul 29 06:36:02.865485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 661/1304] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:02.959106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:02.959809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:02.966549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:02.966988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:02.967752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:02.968189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:03.099929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:03.108089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-018396a4-4cb3-401a-861e-7f3bf1359d34 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153121 Jul 29 06:36:03.108671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 644/1305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:03.178589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:03.180791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:03.186766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:03.187226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:03.187990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:03.188438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:03.218093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c4904dc2-f504-44e0-a454-9cda03388f9d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043545 Jul 29 06:36:03.218637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 662/1306] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:03.878664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:03.880849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:03.886994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:03.887438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:03.888194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:03.888653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:03.918011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d29201a3-6976-41fd-a050-876c23584542 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043347 Jul 29 06:36:03.918568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 645/1307] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:04.129330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:04.129874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:04.136401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:04.136954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:04.137756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:04.138263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:04.231698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:04.234511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:04.241591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:04.242093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:04.242874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:04.243312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:04.271687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:04.273294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fca72cfd-4533-407e-bbd0-dd9c928c3bfd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045608 Jul 29 06:36:04.273864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 646/1308] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:04.280301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9524404-e69b-4a9f-8b4e-69b7e27ff966 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155142 Jul 29 06:36:04.280887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 663/1309] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:04.931147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:04.933350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:04.939464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:04.939919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:04.940725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:04.941169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:04.969894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4ef8dd3f-b1f7-4075-a5a8-dd8479977486 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043043 Jul 29 06:36:04.970442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 647/1310] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:05.285646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:05.287769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:05.294994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:05.295444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:05.296200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:05.296660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:05.300795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:05.301413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:05.308196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:05.308687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:05.309459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:05.309901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:05.325725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c903e85f-e3a9-40e0-92ff-0a9bdf3a51ff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Jul 29 06:36:05.326307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 664/1311] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:05.438788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:05.447265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0cb39690-3f0b-438e-90c8-8e75912fba2e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150281 Jul 29 06:36:05.447824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 648/1312] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:05.982433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:05.984636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:05.990609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:05.991056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:05.992301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:05.992775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:06.021155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a69e1167-8b14-4ef9-bb71-2b48df2b3bfa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042766 Jul 29 06:36:06.021700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 665/1313] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:06.338265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:06.340473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:06.347028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:06.347483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:06.348253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:06.348734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:06.381085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c17c10e5-1484-433e-876d-45b97c616628 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Jul 29 06:36:06.381640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 649/1314] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:06.469349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:06.469955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:06.476359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:06.476851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:06.477603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:06.478036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:06.606915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:06.614353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d3d0aa6b-280a-4030-85d0-b7d4539ffc44 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148858 Jul 29 06:36:06.614905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 666/1315] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:07.033183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:07.035357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:07.041765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:07.042251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:07.043172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:07.043678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:07.073093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dd487511-c90c-422c-9415-d86eb625af15 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044102 Jul 29 06:36:07.073640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 650/1316] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:07.393742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:07.395894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:07.401857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:07.402300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:07.403047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:07.403478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:07.432444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-04f37fc2-18f7-452f-8ea5-f549327fb3d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Jul 29 06:36:07.433028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 667/1317] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:07.636826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:07.637441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:07.644030 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:07.644418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:07.645210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:07.645649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:07.776872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:07.784431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12e76fb9-5f4f-456f-a371-28655107f2b5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152485 Jul 29 06:36:07.785022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 651/1318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:08.086056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:08.088667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:08.095064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:08.095515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:08.096277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:08.096743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:08.126168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-77a0f072-58f9-442c-b8b3-06f8d930be34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044123 Jul 29 06:36:08.126720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 668/1319] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:08.444706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:08.447446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:08.453437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:08.453881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:08.454662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:08.455094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:08.484273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9d741312-013c-486f-a9a0-ff0e4cd7155e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043592 Jul 29 06:36:08.484858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 652/1320] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:08.805024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:08.805640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:08.812435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:08.812914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:08.813669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:08.814104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:08.947347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:08.954972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-45fb33ad-f983-41be-884d-1f680311a026 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153780 Jul 29 06:36:08.955549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 669/1321] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:09.138555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:09.140725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:09.147138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:09.147572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:09.148330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:09.148790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:09.177853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4aa3915a-cdc1-45a3-a427-c903510afeb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043243 Jul 29 06:36:09.178402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 653/1322] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:09.496078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:09.498132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:09.504585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:09.505035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:09.505794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:09.506228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:09.535288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7cc4ff0e-fb3c-463e-86ed-8207d43d75e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Jul 29 06:36:09.535837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 670/1323] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:09.976532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:09.977196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:09.984077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:09.984531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:09.985318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:09.985757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:10.115404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:10.117597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:10.124412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d096088c-ecc2-4d08-b5a5-f2639eb7d8f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151751 Jul 29 06:36:10.125011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 654/1324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:10.190182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:10.192301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:10.198432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:10.198892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:10.199632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:10.200061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:10.230809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a60f3a98-bf45-463c-816f-70d43ce675dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044551 Jul 29 06:36:10.231276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 671/1325] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:10.547449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:10.549592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:10.556070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:10.556777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:10.557551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:10.557991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:10.587909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bf7bf779-953e-44f4-9e37-1b0f55caed54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043770 Jul 29 06:36:10.588724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 655/1326] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:11.147954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:11.148642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:11.155084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:11.155538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:11.156334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:11.156796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:11.243330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:11.246219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:11.252254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:11.252740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:11.253506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:11.253939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:11.283039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8a02e1f3-d079-4dbf-a3b9-ed211a367cf0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043917 Jul 29 06:36:11.283841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 656/1327] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:11.288787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:11.296804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a59f7492-2c44-402a-a268-d144b115477b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155309 Jul 29 06:36:11.297360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 672/1328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:11.599747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:11.601961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:11.609233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:11.609685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:11.610448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:11.610889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:11.639265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a9e6ee30-ffd8-4274-b6cc-d4c2035ba3f7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Jul 29 06:36:11.639803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 657/1329] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:12.295750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:12.298005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:12.304481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:12.304966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:12.305849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:12.306183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:12.318183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:12.318806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:12.325769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:12.326226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:12.326996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:12.327442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:12.331784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:12.336509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-26ae6fa9-c819-4075-b108-142695e25f95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Jul 29 06:36:12.337713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 673/1330] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:12.456850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:12.464747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9d4d265e-6a17-4ddb-9f28-578a7f370677 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150558 Jul 29 06:36:12.465300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 658/1331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:12.652259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:12.654436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:12.660747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:12.661197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:12.661950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:12.662388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:12.690777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b0767f4b-aef3-4efa-906d-227945f371f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Jul 29 06:36:12.691315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 674/1332] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:13.349933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:13.352096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:13.359034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:13.359488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:13.360251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:13.360720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:13.390512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3d8bd218-81dd-4e27-87a9-06ef5832505e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044651 Jul 29 06:36:13.391053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 659/1333] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:13.486111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:13.486730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:13.494215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:13.494670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:13.495503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:13.495873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:13.623327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:13.631031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8abf2496-b66b-4646-92ac-97d92f1fe60d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148814 Jul 29 06:36:13.631600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 675/1334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:13.703395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:13.705622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:13.712523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:13.713019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:13.713783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:13.714225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:13.744277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ddf5c4f8-bb5c-49a4-8e38-0a68b2288d93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Jul 29 06:36:13.744869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 660/1335] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:14.404284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:14.406734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:14.412805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:14.413260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:14.414015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:14.414447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:14.444757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-841a92d3-b3c2-48bc-9a63-92f76e7f57e4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044959 Jul 29 06:36:14.445319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 676/1336] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:14.652744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:14.653622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:14.660070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:14.660442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:14.661234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:14.661668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:14.756744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:14.759878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:14.767011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:14.767608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:14.768389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:14.768862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:14.800613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fd98e30a-ee9f-438b-a535-f5dc015a00a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047841 Jul 29 06:36:14.801196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 677/1337] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:14.815634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:14.823808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c19de92d-a46d-42d5-bf67-58b337243c89 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.174960 Jul 29 06:36:14.824405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 661/1338] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:15.458270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:15.460413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:15.467169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:15.467624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:15.468381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:15.468847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:15.498576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-459269b7-d3c3-4c16-aed8-d0289a88d011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044173 Jul 29 06:36:15.499252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 678/1339] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:15.812892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:15.815042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:15.822088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:15.822538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:15.823295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:15.823726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:15.844815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:15.845433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:15.851894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:15.852353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:15.853286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:15.853727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:15.855627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-766e9b0b-8d3f-4fa4-8e8e-1bee930edcaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046701 Jul 29 06:36:15.856189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 662/1340] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:15.991057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:15.998555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ab96cbc5-ad7c-429f-927f-cf23b4af3020 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157719 Jul 29 06:36:15.999112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 679/1341] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:16.511305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:16.513489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:16.519501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:16.519943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:16.520728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:16.521166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:16.550116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-86a93f0a-b033-49de-a78d-f851a597ff9a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043086 Jul 29 06:36:16.550663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 663/1342] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:16.867399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:16.869756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:16.876198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:16.876675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:16.877437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:16.877872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:16.905990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c14949d-90ea-49a4-abbc-a91e912c443d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042546 Jul 29 06:36:16.906532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 680/1343] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:17.019882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:17.020488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:17.027508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:17.027952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:17.028772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:17.029205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:17.158355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:17.166408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0cf95d67-d7f0-410c-b27f-a9bfc85d38f7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150299 Jul 29 06:36:17.166968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 664/1344] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:17.562235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:17.564370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:17.570509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:17.570963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:17.572374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:17.572845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:17.601653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-12c1c320-36b6-4a56-a991-2ca1bc7e9ab4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043406 Jul 29 06:36:17.602199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 681/1345] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:17.918385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:17.921138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:17.927215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:17.927658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:17.928416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:17.928905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:17.958307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b9ec2f0d-ef0b-4c64-81c7-d17094b31178 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Jul 29 06:36:17.958850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 665/1346] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:18.187826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:18.188374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:18.194729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:18.195173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:18.195925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:18.196459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:18.324049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:18.331935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ae564ea3-c9db-4fca-a609-b85aa92f4258 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148196 Jul 29 06:36:18.332495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 682/1347] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:18.614166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:18.616339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:18.622853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:18.623303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:18.624058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:18.624491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:18.653128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c58d3bdb-cdea-4231-a81a-1a7b9dbb7ac7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042958 Jul 29 06:36:18.653666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 666/1348] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:18.970220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:18.972293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:18.978508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:18.978964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:18.979735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:18.980178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:19.008270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bd9cee22-412d-4874-b619-973f4f82b232 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042057 Jul 29 06:36:19.009548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 683/1349] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:19.352687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:19.353348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:19.359423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:19.359873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:19.360993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:19.361433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:19.498850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:19.506087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1735796e-df79-4540-9fc1-5b3cc0ce6865 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157303 Jul 29 06:36:19.506647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 667/1350] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:19.666025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:19.668101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:19.674537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:19.674983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:19.675740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:19.676173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:19.704421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-727f774f-081c-4ed8-8b20-b00cc55ad8ad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043037 Jul 29 06:36:19.704991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 684/1351] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:20.021420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:20.023485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:20.030000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:20.030469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:20.031208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:20.031644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:20.060417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c3dec1fa-0d37-47a0-bcb2-0df7b3ff9f7f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043093 Jul 29 06:36:20.060977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 668/1352] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:20.527458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:20.528093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:20.534125 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:20.534568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:20.535331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:20.535764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:20.668262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:20.676207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-09f8ebc5-4eeb-4f31-8975-508d96f35413 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152883 Jul 29 06:36:20.676806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 685/1353] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:20.716747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:20.718925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:20.724957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:20.725400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:20.726164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:20.726600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:20.755946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f04d1129-4244-4b35-abfd-ad0054291d21 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043208 Jul 29 06:36:20.756499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 669/1354] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:21.072671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:21.074801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:21.080732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:21.081443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:21.082197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:21.082631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:21.111038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0a7231a0-66f7-41c2-a178-e754bafa7439 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042405 Jul 29 06:36:21.111576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 686/1355] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:21.697809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:21.698427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:21.704472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:21.705027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:21.705795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:21.706497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:21.768920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:21.771089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:21.780194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:21.780671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:21.781451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:21.781917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:21.813759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-99def639-74fd-4ff2-b68f-82326515cbb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048840 Jul 29 06:36:21.814333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 687/1356] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:21.839376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:21.846789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b98e6bb4-5c90-48ef-aa47-298a733e2eec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153097 Jul 29 06:36:21.847346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 670/1357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:22.123783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:22.125962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:22.131894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:22.132353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:22.133154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:22.134179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:22.162462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d7083a09-6075-4945-809c-287ee00e3ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042646 Jul 29 06:36:22.163008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 688/1358] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:22.825272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:22.827401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:22.834130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:22.834573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:22.835322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:22.835751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:22.850055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:22.866872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7de01d40-6aa8-41ec-a109-b586eb6a3488 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045665 Jul 29 06:36:22.867431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 671/1359] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:22.867664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:22.868913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:22.875571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:22.876021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:22.876810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:22.877248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:23.005564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:23.013838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-df464cfe-f6cb-40b7-a7fe-cd11530bacbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150039 Jul 29 06:36:23.014394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 689/1360] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:23.175073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:23.177253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:23.184105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:23.184581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:23.185347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:23.185787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:23.215633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a57d2274-0e60-4918-9b92-8d397e09670d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Jul 29 06:36:23.216212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 672/1361] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:23.880343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:23.882519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:23.889322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:23.889843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:23.890612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:23.891045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:23.904522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:23.920206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-81c9b757-7fcb-4ee6-a1da-1674ab63f983 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044092 Jul 29 06:36:23.920792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 690/1362] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:24.035168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:24.035782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:24.042992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:24.043442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:24.044198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:24.044653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:24.171760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:24.179395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8fd67e8b-5024-42e5-86c4-b0c2c03b6023 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148011 Jul 29 06:36:24.179989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 673/1363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:24.227230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:24.229490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:24.235420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:24.235890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:24.236669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:24.237109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:24.266599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-108cd6fe-c552-4317-a43a-6370a45bb27d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Jul 29 06:36:24.267151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 691/1364] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:24.933535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:24.935710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:24.941873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:24.942326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:24.943194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:24.943670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:24.972435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3b890af7-2a4e-40c0-b008-f933700938a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043771 Jul 29 06:36:24.973014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 674/1365] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:25.200572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:25.201187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:25.207813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:25.208260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:25.209039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:25.209468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:25.279458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:25.281679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:25.288047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:25.288502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:25.289302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:25.290375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:25.319558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6ae34720-7206-4353-8d7e-14f0c02f3f13 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044108 Jul 29 06:36:25.320109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 675/1366] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:25.339164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:25.346600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-44770172-494d-4f47-85b2-539d7186aaf9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149891 Jul 29 06:36:25.347157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 692/1367] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:25.984888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:25.987023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:25.993542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:25.993985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:25.994737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:25.995167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:26.023923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12cbbf14-1c9e-4f06-a5b7-1b69d9b6b882 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042969 Jul 29 06:36:26.024856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 676/1368] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:26.331637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:26.333746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:26.341275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:26.341724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:26.342487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:26.342927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:26.367996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:26.368579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:26.372414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-babfb6b0-f083-4a8b-8df4-6663969c35db tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045016 Jul 29 06:36:26.373020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 693/1369] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:26.375833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:26.376285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:26.377092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:26.377527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:26.511111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:26.519287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1fb1b92c-d4d5-4065-b29b-7c4cf6788cb8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155588 Jul 29 06:36:26.519848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 677/1370] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:27.037217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:27.039366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:27.046906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:27.047362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:27.048127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:27.048590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:27.077047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fb5494ba-f475-4188-be99-847616a1fe22 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044157 Jul 29 06:36:27.077590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 694/1371] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:27.385304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:27.387565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:27.393998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:27.394448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:27.395205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:27.395639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:27.424367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4962c697-e66b-4387-94c4-7f4998c8da79 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043691 Jul 29 06:36:27.424932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 678/1372] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:27.541630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:27.542274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:27.548700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:27.549157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:27.549917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:27.550356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:27.683875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:27.691337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b5a10882-005c-4fb7-bd8a-f77855a83e30 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154004 Jul 29 06:36:27.691893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 695/1373] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:28.089727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:28.091898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:28.097851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:28.098298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:28.099059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:28.099494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:28.128213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0febec1e-b8d0-4ba0-b747-765a4737b35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043200 Jul 29 06:36:28.128778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 679/1374] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:28.437636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:28.439685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:28.445698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:28.446169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:28.446965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:28.447394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:28.475676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe907c75-b761-4daf-9ba8-7d67559e898e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042196 Jul 29 06:36:28.476219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 696/1375] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:28.713755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:28.714286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:28.721000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:28.721453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:28.722218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:28.722655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:28.931789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:28.939380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9038a5da-2791-4728-9d0b-6a5daf4c5d70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.230326 Jul 29 06:36:28.939943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 680/1376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:29.140678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:29.142833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:29.149973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:29.150429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:29.151192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:29.151634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:29.179362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fd23cea5-a1e6-4f93-a88d-d0d33df3f3cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042784 Jul 29 06:36:29.179911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 697/1377] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:29.489191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:29.494119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:29.500303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:29.501022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:29.502020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:29.502825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:29.538781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1dd2c338-3b23-47d6-977c-e570c58d3e69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053825 Jul 29 06:36:29.540141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 681/1378] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:29.961134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:29.962420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:29.964251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:29.969664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:29.970117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:29.970880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:29.971318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:30.142706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:30.150433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1f82ecab-e67c-45ae-a524-9d8739601dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.193130 Jul 29 06:36:30.150992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 698/1379] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:30.191311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:30.193452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:30.200528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:30.201005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:30.201762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:30.202193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:30.230552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68ff0dbc-e05a-4348-a66e-9058cf725a32 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043133 Jul 29 06:36:30.231050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 682/1380] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:30.551616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:30.553710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:30.560893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:30.561343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:30.562110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:30.562543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:30.592011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-83383a3b-9556-4a97-b60b-086c6869f301 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Jul 29 06:36:30.592577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 699/1381] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:31.171437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:31.172048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:31.173908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:31.179205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:31.179652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:31.181117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:31.181541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:31.243373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:31.245773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:31.252285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:31.252823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:31.253673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:31.254185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:31.283719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-25e5a8e1-b629-4b4c-a08c-d5af50938ca6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045065 Jul 29 06:36:31.293150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 700/1382] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:31.320682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:31.328531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4f26aa4d-eeb7-4343-80f5-ae041209317a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.160991 Jul 29 06:36:31.329112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 683/1383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:31.604914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:31.607053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:31.613080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:31.613555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:31.614317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:31.614753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:31.643855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8a0b2d6c-abe3-46f0-899e-9edaa6e9d3a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Jul 29 06:36:31.644413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 701/1384] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:32.296573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:32.298893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:32.305951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:32.306425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:32.307181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:32.307638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:32.335913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8b76067-40e6-4f5d-8a3c-64bfa8d09790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Jul 29 06:36:32.337157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 684/1385] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:32.349937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:32.350545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:32.357805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:32.358251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:32.359006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:32.359434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:32.490977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:32.498963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-00329aa6-ccc3-4952-b7af-afea080c2e8e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152850 Jul 29 06:36:32.499525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 702/1386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:32.655477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:32.657674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:32.663580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:32.664030 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:32.665406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:32.665838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:32.694047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dc23c8ca-9861-4b86-a3ed-db55d334384d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042595 Jul 29 06:36:32.694584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 685/1387] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:33.348567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:33.350708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:33.357645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:33.358090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:33.358854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:33.359289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:33.387760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-375ea523-238c-45e5-9f08-275363925bc8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043200 Jul 29 06:36:33.388304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 703/1388] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:33.520422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:33.521093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:33.528445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:33.528930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:33.529688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:33.530125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:33.659454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:33.667161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0ebe3d94-e927-4ee6-91a5-3ccff1d7eb81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150648 Jul 29 06:36:33.667708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 686/1389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:33.706581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:33.708767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:33.715462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:33.715911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:33.716730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:33.717188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:33.746499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ab807b2e-7e30-4aee-852d-4ac8fd237ab4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044028 Jul 29 06:36:33.747056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 704/1390] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:34.400337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:34.402516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:34.408685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:34.409137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:34.409899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:34.410366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:34.414071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:36:34.414961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments (ip 10.222.0.33) !!! Jul 29 06:36:34.442445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e57395bc-6b0f-4fe0-86b3-be3a07d5d963 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046332 Jul 29 06:36:34.443006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 687/1391] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:34.688392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:34.688962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:34.695402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:34.695899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:34.696737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:34.697201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:34.759088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:34.761302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:34.767796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:34.768255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:34.769074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:34.769519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:34.773205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:34.801795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e5ddd670-7de5-45b9-95e0-5191e3fcb779 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046883 Jul 29 06:36:34.802366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 688/1392] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:34.831774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:34.839786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-796c879c-088e-48c7-996c-64acba10f91d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155300 Jul 29 06:36:34.840338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 705/1393] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:35.455436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:35.457884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:35.464720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:35.465208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:35.465984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:35.466429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:35.494897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7aa01a38-c09a-42cc-b11f-f952be0c4b73 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Jul 29 06:36:35.495438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 689/1394] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:35.814217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:35.816389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:35.822973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:35.823419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:35.824177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:35.824633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:35.856286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a5c94fc2-9ff1-4bb6-9f39-b485c6ecd43b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046029 Jul 29 06:36:35.856867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 706/1395] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:35.860331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:35.860992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:35.867463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:35.867909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:35.868779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:35.869375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:35.997854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:36.005390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fddde0eb-a220-4080-aefc-878bd8278bf2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148945 Jul 29 06:36:36.005947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 690/1396] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:36:36.506465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:36.508615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:36.515322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:36.515768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:36.516570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:36.516994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:36.519307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:36.546596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4aaf1673-216f-4a3e-ab33-635921dc52bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Jul 29 06:36:36.547158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 707/1397] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:36.931920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:36.934373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:36.940401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:36.940890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:36.941663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:36.942111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:36.970911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b12a9e0f-d53f-4631-ada2-6c4aa5339a40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106366 Jul 29 06:36:36.971464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 691/1398] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:37.027216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:37.027834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:37.034456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:37.034913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:37.035681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:37.036129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:37.165029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:37.173271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5bc41142-f0a3-47c7-8862-4dcc06b56e7d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149997 Jul 29 06:36:37.173827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 708/1399] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:37.559076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:37.561252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:37.567263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:37.567708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:37.568463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:37.568931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:37.598682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-da154b89-7818-4f08-8ebc-cb1444bc0436 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043768 Jul 29 06:36:37.599218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 692/1400] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:37.983483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:37.985682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:37.991636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:37.992084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:37.992870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:37.993301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:38.022639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c3d80ea8-7f3b-49f6-b2cf-7410c325d974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Jul 29 06:36:38.023186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 709/1401] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:38.194010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:38.194661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:38.201645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:38.202094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:38.202856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:38.203292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:38.335620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:38.343784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-63a9ccab-420e-42b1-a31e-bd1e9b5d4b25 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153718 Jul 29 06:36:38.344350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 693/1402] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:38.611554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:38.613755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:38.621434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:38.621886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:38.622662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:38.623104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:38.653183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4d1f4ba4-54c6-4a28-a494-dccdacf97fb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045564 Jul 29 06:36:38.653966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 710/1403] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:39.035297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:39.037627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:39.044274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:39.044769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:39.045576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:39.046014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:39.077425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a16386ab-9888-4c13-834f-298a940725d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046095 Jul 29 06:36:39.078010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 694/1404] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:39.365198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:39.365814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:39.372062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:39.372517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:39.373305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:39.373753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:39.504432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:39.513056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cb50aadf-ebea-4887-adb6-0bc6cc24b3e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151693 Jul 29 06:36:39.513632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 711/1405] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:39.665480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:39.667692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:39.674155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:39.674601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:39.675387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:39.675820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:39.706179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fcde64ad-7f4f-4e93-be26-157075e740d2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044653 Jul 29 06:36:39.706990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 695/1406] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:40.091004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:40.093250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:40.099831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:40.100226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:40.101034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:40.101474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:40.130901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d22610d3-2db6-455e-a605-467fc3b2a278 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Jul 29 06:36:40.131452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 712/1407] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:40.535246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:40.535788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:40.542359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:40.542810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:40.543570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:40.544008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:40.623858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:36:40.624019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:36:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:36:40.671999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:40.679897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c6b768f5-a51b-42fd-b0fd-6440e0a0335f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148622 Jul 29 06:36:40.680458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 696/1408] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:40.719469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:40.721628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:40.727615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:40.728082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:40.728853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:40.729283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:40.757853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-78212336-5d8e-44ba-b8e7-193541ab3939 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042308 Jul 29 06:36:40.758396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 713/1409] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:41.142624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:41.144888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:41.151062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:41.151517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:41.152292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:41.152770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:41.181651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cf8f4bb7-575c-4af1-b6fe-f3ff89dc50a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042568 Jul 29 06:36:41.182334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 697/1410] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:41.700844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:41.701421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:41.708297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:41.708790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:41.709555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:41.709997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:41.770856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:41.773121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:41.779866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:41.780386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:41.781412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:41.781919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:41.816517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3b65dea3-b5c2-429f-b722-ad78a8ed8b42 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049586 Jul 29 06:36:41.817126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 698/1411] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:41.847608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:41.855349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-baa29c30-1468-46a6-85b8-2d481ee7c1dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.159311 Jul 29 06:36:41.855905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 714/1412] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:42.193934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:42.196066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:42.202073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:42.202520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:42.203276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:42.203709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:42.233084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7372e51e-6b6e-4a22-9ece-c68d31f26e6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 Jul 29 06:36:42.233622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 699/1413] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:42.828949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:42.831014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:42.838002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:42.838445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:42.839198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:42.839633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:42.869492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-656872b0-9e98-49d7-8011-793aaeb51152 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043957 Jul 29 06:36:42.870031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 715/1414] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:42.876020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:42.876654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:42.883045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:42.883491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:42.884290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:42.884757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:43.016717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:43.024219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2597fe1-5b1b-4ace-a93b-fc08b00e062b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152093 Jul 29 06:36:43.024894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 700/1415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:43.245465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:43.247603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:43.253533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:43.253982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:43.254739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:43.255176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:43.283906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c5fd433c-13e8-495f-82c9-8aefca609cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042509 Jul 29 06:36:43.284456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 716/1416] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:43.882093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:43.884889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:43.891458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:43.891891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:43.892699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:43.893138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:43.921404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-09d85ac5-6129-444c-a250-17957f356344 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043369 Jul 29 06:36:43.921950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 701/1417] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:44.046188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:44.046794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:44.053266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:44.053714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:44.054465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:44.054897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:44.185331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:44.192658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd03af97-d5e2-4d6d-a814-3c4bfe3a4249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150431 Jul 29 06:36:44.193208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 717/1418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:44.295335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:44.297554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:44.303567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:44.304022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:44.304815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:44.305260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:44.335028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8bc3c456-cafe-4725-889a-7e8be1436577 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043703 Jul 29 06:36:44.335573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 702/1419] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:44.933827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:44.935940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:44.941977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:44.942420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:44.943173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:44.943602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:44.972650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f96782e-1058-4e38-a22d-c37dc0131734 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042843 Jul 29 06:36:44.973183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 718/1420] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:45.215463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:45.216112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:45.222826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:45.223282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:45.224081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:45.224523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:45.347518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:45.349817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:45.352000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:45.356456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:45.356944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:45.357723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:45.358165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:45.359853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-612d09b1-338f-4756-8379-4cff7ab533a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148837 Jul 29 06:36:45.360426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 703/1421] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:45.388573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c39d4e11-09fb-4a73-9379-2922a0f2ceb0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045139 Jul 29 06:36:45.389127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 719/1422] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:45.985819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:45.989520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:45.998686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:45.999144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:45.999936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:46.000360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:46.024596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:46.029266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-43e6b237-c9f4-467b-95af-ac796dd4c7a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047996 Jul 29 06:36:46.029827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 704/1423] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:46.382152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:46.382762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:46.389149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:46.389594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:46.390351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:46.390780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:46.401645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:46.403845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:46.410697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:46.411243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:46.412185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:46.412655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:46.442934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fccf34e6-68ce-4f11-ae84-749531867a26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046049 Jul 29 06:36:46.443694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 705/1424] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:46.522145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:46.530552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-271f227f-ea39-46d7-9735-b175316038f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152554 Jul 29 06:36:46.531104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 720/1425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:47.041767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:47.044052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:47.050289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:47.050736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:47.051492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:47.051927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:47.081002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4cd4373c-f1b5-40d3-9970-8a6ea234d08e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043234 Jul 29 06:36:47.081805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 706/1426] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:47.455239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:47.457683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:47.464886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:47.465345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:47.466118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:47.466565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:47.495114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-000b49b2-d627-4a8b-9edf-8430ef9479d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Jul 29 06:36:47.495658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 721/1427] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:47.551018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:47.551631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:47.558122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:47.558567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:47.559319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:47.559752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:47.692895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:47.700972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3e0ac4b8-58b3-4352-bc2c-ee683304288a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153739 Jul 29 06:36:47.701532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 707/1428] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:48.094438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:48.096604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:48.102547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:48.102994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:48.103839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:48.104286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:48.132521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7123dfd3-b764-4afb-a032-7a768de8df68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042271 Jul 29 06:36:48.133087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 722/1429] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:48.507473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:48.510355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:48.516227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:48.516716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:48.517471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:48.517909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:48.546542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ebab831a-c61e-46fd-b76d-d680356be9b5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043097 Jul 29 06:36:48.547091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 708/1430] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:48.722162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:48.722671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:48.729873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:48.730332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:48.731112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:48.731549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:48.862728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:48.864936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:48.872550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fb5757c7-4fd9-406a-91a2-6d1a8600d4bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154358 Jul 29 06:36:48.873138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 723/1431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:49.207564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:49.209831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:49.216512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:49.216994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:49.217755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:49.218193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:49.248084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f5a31198-2844-45d8-b0c6-44b63ea3f43e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.107436 Jul 29 06:36:49.248669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 709/1432] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:49.558966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:49.561298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:49.567413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:49.567866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:49.568670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:49.569111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:49.600904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b5c4783-13c5-4bb6-8f99-da95ff8e85da tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046045 Jul 29 06:36:49.601453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 724/1433] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:49.893671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:49.894286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:49.900659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:49.901120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:49.901861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:49.902289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:50.029277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:50.036951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1e3e4462-4c7d-458c-bb59-79484004865b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147179 Jul 29 06:36:50.037523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 710/1434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:50.260819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:50.262919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:50.269351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:50.269801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:50.270547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:50.270978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:50.300033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c37008a-aec0-4c63-8b74-ba81c9ceffe4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043382 Jul 29 06:36:50.300591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 725/1435] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:50.612867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:50.615034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:50.621566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:50.622023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:50.622791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:50.623235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:50.652408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-26e9da57-9093-4665-8806-078d2e84acac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Jul 29 06:36:50.652986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 711/1436] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:51.057381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:51.057998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:51.064001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:51.064456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:51.065249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:51.065686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:51.194827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:51.203499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b1a6a4e-0e01-46dc-a8aa-a25d119ac184 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150065 Jul 29 06:36:51.204054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 726/1437] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:51.312608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:51.314872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:51.320901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:51.321355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:51.322692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:51.323131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:51.352443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a1f84348-29fa-4931-a130-843f89aee776 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044308 Jul 29 06:36:51.354160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 712/1438] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:51.664196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:51.667031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:51.673570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:51.674024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:51.674790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:51.675258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:51.703513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-236ac283-25b9-48c4-8f2a-6242ded32092 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043285 Jul 29 06:36:51.704060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 727/1439] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:52.225374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:52.225989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:52.232634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:52.233033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:52.233795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:52.234234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:52.362337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:52.366738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:52.369612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:52.370578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6892ebf1-d6ed-4846-9f20-45957d6d8f96 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149110 Jul 29 06:36:52.371156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 713/1440] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:52.375499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:52.375947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:52.376727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:52.377156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:52.405730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-50633dcd-c213-41c2-b7f4-41a54891e74b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042940 Jul 29 06:36:52.406270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 728/1441] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:52.716088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:52.718314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:52.724719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:52.725176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:52.726012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:52.726455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:52.757199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cac1f071-1c5c-4130-9f23-b6b611ae9be0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Jul 29 06:36:52.757752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 714/1442] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:53.391217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:53.391825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:53.398287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:53.398734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:53.399485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:53.400194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:53.418688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:53.421008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:53.427458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:53.427911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:53.428709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:53.429153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:53.459296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2e2b2f48-c2ac-40b8-a784-d3ee4ef2a321 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045245 Jul 29 06:36:53.459860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 715/1443] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 06:36:53.530198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:53.537707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b33b1b45-c412-48d8-a94b-145cd12986fe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150383 Jul 29 06:36:53.538263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 729/1444] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:53.769195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:53.771423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:53.778228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:53.778685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:53.779460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:53.779900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:53.810616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d03bbb61-2863-433e-80d4-0e269e39a1a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045550 Jul 29 06:36:53.811186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 716/1445] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:54.471416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:54.473578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:54.481214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:54.481667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:54.482439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:54.482918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:54.512023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f131c30e-9eef-4c46-ab74-110d3c594758 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044598 Jul 29 06:36:54.516823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 730/1446] 10.222.0.33 () {60 vars in 1343 bytes} [Fri Jul 29 06:36:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:36:54.559456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:54.559975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:54.566503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:54.567007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:54.567770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:54.568210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:54.699924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:54.707612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-352fc467-b424-4676-9005-0b984ee248a3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152118 Jul 29 06:36:54.708152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 717/1447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:54.822991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:54.825204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:54.831146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:54.831868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:54.832658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:54.833101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:54.861854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f9da94d9-7e81-4605-8d45-5b283b196063 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043470 Jul 29 06:36:54.862405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 731/1448] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:55.525052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:36:55.527279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:55.533450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:55.533903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:55.534665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:55.535103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:55.617742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ce1f14a5-a7ff-44ca-9afc-43f296490ada tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/action" status: 200 len: 37617 microversion: 2.20 time: 0.096709 Jul 29 06:36:55.619101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 718/1449] 10.222.0.33 () {62 vars in 1319 bytes} [Fri Jul 29 06:36:55 2022] POST /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f/action => generated 37617 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:36:55.730590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:55.731207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:55.737786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:55.738244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:55.739003 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:55.739437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:55.870339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:55.874897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:55.877171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:55.877925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22d89384-6474-4eca-b78d-c649e5036b4b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152049 Jul 29 06:36:55.878485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 732/1450] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:55.883950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:55.884528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:55.885350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:55.885796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:55.916510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-beb845d2-c228-4ac2-bde6-de2787b1698f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Jul 29 06:36:55.917086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 719/1451] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:56.898886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:56.899523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:56.906484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:56.906939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:56.907699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:56.908133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:56.928832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:56.931635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:56.938221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:56.938673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:56.939444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:56.939890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:56.970596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e8206f1-e1dd-4745-8937-30437b75bd45 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045685 Jul 29 06:36:56.971157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 720/1452] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:36:57.039681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:57.048097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a4e37400-f687-4a35-8e99-823c26ae4a48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153054 Jul 29 06:36:57.048736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 733/1453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:57.983181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:57.985424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:57.991785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:57.992235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:57.993016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:57.994089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:58.018137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:36:58.023118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-95a7ce3c-d9e8-4c80-920b-4970d1b79ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043898 Jul 29 06:36:58.023650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 721/1454] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:58.068059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:58.068707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:58.075626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:58.076078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:58.076874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:58.077374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:58.208516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:58.216811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-100bc145-40ed-45a8-a834-72e04fa42948 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152407 Jul 29 06:36:58.217373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 734/1455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:36:59.034982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:59.037097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:59.044216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:59.044712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:59.045493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:59.045936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:59.074358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ce49342-dfc5-4d9f-afe1-2379ab7e765c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Jul 29 06:36:59.074915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 722/1456] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:36:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:36:59.238347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:36:59.238969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:36:59.245812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:59.246262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:59.247094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:36:59.247534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:36:59.376592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:36:59.384509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aace9c02-9632-44ad-b2ef-0bfd0c039441 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149408 Jul 29 06:36:59.385179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 735/1457] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:36:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:00.087071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:00.089270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:00.096231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:00.096717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:00.097486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:00.097921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:00.127408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc47ab91-6a86-4dee-9273-5bbf23937da8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044343 Jul 29 06:37:00.127954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 723/1458] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:00.406091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:00.406647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:00.409037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=76 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:00.414244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:00.414692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:00.415491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:00.415923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:00.545884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:00.553378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0470be5f-e342-41e0-9bc0-bc18cc8836db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151223 Jul 29 06:37:00.553939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 736/1459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:01.140283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:01.142520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:01.149096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:01.149611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:01.150555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:01.150997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:01.179316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-37a3c70e-0a8b-4969-a184-b822e79fdf6e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Jul 29 06:37:01.179854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 724/1460] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:01.575961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:01.576604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:01.583385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:01.583832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:01.584619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:01.585150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:01.718162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:01.725857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3ac30ba4-2f77-456f-82c9-c1fec867f1ca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154663 Jul 29 06:37:01.726420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 737/1461] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:02.191535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:02.193795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:02.196088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:02.202536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:02.202993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:02.203771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:02.204215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:02.234178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c323342-8fc0-4845-ab27-92a2a88f32e1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Jul 29 06:37:02.234727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 725/1462] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:02.746986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:02.747603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:02.754264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:02.754805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:02.755575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:02.756019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:02.883422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:02.890983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bb21f0bb-c37e-416f-9029-df70faf84cc4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148087 Jul 29 06:37:02.891550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 738/1463] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:03.247138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:03.249352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:03.255887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:03.256332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:03.257123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:03.257556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:03.285793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ce2ae50d-a1f9-4517-964f-be20317701a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043384 Jul 29 06:37:03.286330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 726/1464] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:03.912622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:03.913239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:03.920222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:03.920713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:03.921476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:03.921919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:04.056345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:04.063802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac9ee471-fad5-4174-a6dd-6d23ebdd9a32 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155103 Jul 29 06:37:04.064370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 739/1465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:04.299164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:04.301306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:04.308470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:04.308954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:04.309723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:04.310168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:04.339536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a4c52ed0-5da3-412c-a871-14c300a81c0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Jul 29 06:37:04.340116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 727/1466] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:05.087447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:05.088272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:05.094775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:05.095229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:05.095990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:05.096427 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:05.111510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:05.224129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:05.232247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9dead8f0-eb44-4b3f-a5c5-1124c799a063 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149218 Jul 29 06:37:05.232839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 740/1467] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:05.351817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:05.354091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:05.360631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:05.361093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:05.361867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:05.362312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:05.391254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af784d7b-63a6-4029-88ac-d2446db656c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Jul 29 06:37:05.391797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 728/1468] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:06.253228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:06.253836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:06.261129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:06.261578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:06.262340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:06.262770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:06.395248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:06.402855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b3670578-8db4-4b70-983a-dd19803de5f0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153428 Jul 29 06:37:06.403517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 741/1469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:06.404266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:06.406480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:06.412387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:06.412874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:06.413645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:06.414080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:06.444853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24451ebe-4ddd-44a6-b7b4-ebdb55d48d40 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045375 Jul 29 06:37:06.445418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 729/1470] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:37:07.423127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:07.423733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:07.430213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:07.431435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:07.432091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:07.432521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:07.458428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:07.460644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:07.467302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:07.467759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:07.468528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:07.468997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:07.500446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9e627939-6eee-44fa-8a73-c05e4d3f61fb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046218 Jul 29 06:37:07.501063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 730/1471] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:37:07.802310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:07.810471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3a3141d3-8e9a-4737-81c0-7100feef5d23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.391188 Jul 29 06:37:07.811040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 742/1472] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:08.512880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:08.515045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:08.521576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:08.522058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:08.522814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:08.523246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:08.553291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c107bb17-a7e7-466e-a25f-60a8c01415dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Jul 29 06:37:08.553841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 731/1473] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:08.831312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:08.832107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:08.839249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:08.839699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:08.840465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:08.840931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:08.970227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:08.978349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c25b3849-3434-46b4-86f7-8b21e6665744 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150411 Jul 29 06:37:08.978916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 743/1474] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:09.565573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:09.567715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:09.574852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:09.575301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:09.576055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:09.576496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:09.604643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d08f5c98-35e9-489e-a2cd-217a11605bc6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042992 Jul 29 06:37:09.605183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 732/1475] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:09.999934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:10.000564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:10.006992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:10.007441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:10.008194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:10.008655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:10.138099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:10.145842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6ad3de59-0fb3-4740-91e7-2f879652be1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149765 Jul 29 06:37:10.146424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 744/1476] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:10.616035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:10.619348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:10.625831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:10.626284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:10.627051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:10.627488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:10.656360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e6432042-8724-496f-8c43-076828cf894b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044291 Jul 29 06:37:10.656932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 733/1477] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:11.167469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:11.168086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:11.174590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:11.175034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:11.175789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:11.176220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:11.302942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:11.311195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-44c367ed-4082-42d3-bc43-0a8aa6902c90 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147721 Jul 29 06:37:11.311774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 745/1478] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:11.395340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:37:11.395540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:37:11.669116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:11.671312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:11.677841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:11.678299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:11.679067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:11.679509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:11.708506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-da32906f-9ab3-477e-94df-1a5cd962f165 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043921 Jul 29 06:37:11.709076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 734/1479] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:12.332867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:12.333479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:12.341552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:12.342001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:12.342767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:12.343202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:12.475376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:12.483029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-66b823b9-16b0-4990-81aa-3e1afa678ef9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154365 Jul 29 06:37:12.483595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 746/1480] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:12.721630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:12.723825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:12.732108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:12.732974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:12.734211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:12.734396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:12.764665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-18963c21-afb9-4398-a11c-0564fbe9949e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047056 Jul 29 06:37:12.765217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 735/1481] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:13.504441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:13.505101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:13.511693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:13.512148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:13.512943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:13.513386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:13.640447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:13.648294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4bced815-d7b1-41fc-bbe4-baf22f3bd681 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.147691 Jul 29 06:37:13.648896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 747/1482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:13.777023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:13.779088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:13.785572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:13.786017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:13.786781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:13.787212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:13.816577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b085d666-21d7-45f6-8070-72911177eebe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Jul 29 06:37:13.817114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 736/1483] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:14.669880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:14.670492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:14.676972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:14.677424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:14.678182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:14.678637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:14.812424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:14.819920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a7fd4b51-18fc-4b94-9b05-43d1f99e68ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153921 Jul 29 06:37:14.820479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 748/1484] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:14.828866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:14.831029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:14.837467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:14.837911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:14.838700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:14.839135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:14.867643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f30cb482-6660-4d4b-b9ca-39160e00f23d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042645 Jul 29 06:37:14.869006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 737/1485] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:15.841739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:15.842353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:15.848839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:15.849293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:15.850056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:15.850494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:15.880781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:15.882914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:15.889453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:15.889925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:15.890666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:15.891098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:15.904997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:15.922394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ba0aee6-0544-4f92-b014-2957d15f01a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Jul 29 06:37:15.922963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 738/1486] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:37:15.982151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:15.989556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-655b0fa5-c7ff-49a2-9992-c0a3d5374295 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151677 Jul 29 06:37:15.990054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 749/1487] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:16.935213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:16.937560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:16.944156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:16.944637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:16.945403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:16.945839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:16.975750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8aaffcdb-349f-4ecc-a576-512befd5eb29 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Jul 29 06:37:16.976314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 739/1488] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:17.010939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:17.011503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:17.017981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:17.018435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:17.019199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:17.019637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:17.148339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:17.156298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8bbda545-9a40-4559-b2d2-e19e6cb65754 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149301 Jul 29 06:37:17.156887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 750/1489] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:17.988711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:17.990877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:17.997670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:17.998118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:17.998874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:17.999311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:18.028690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2d25528-672d-4a1b-a268-ec72402a14f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Jul 29 06:37:18.029225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 740/1490] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:18.178166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:18.178790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:18.185397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:18.185851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:18.186616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:18.187057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:18.319191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:18.327193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ba9f0e1a-2e1a-433b-bb67-24787d03a5b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152980 Jul 29 06:37:18.327754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 751/1491] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:19.041692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:19.043774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:19.050308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:19.050766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:19.051539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:19.051982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:19.081072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-236eeaa0-b46b-4a66-9369-d59d8e279709 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043967 Jul 29 06:37:19.081619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 741/1492] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:19.348163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:19.348812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:19.355785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:19.356242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:19.357048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:19.357493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:19.493775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:19.501220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-28e2784c-c28a-4889-ba3d-f52e393788cf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156948 Jul 29 06:37:19.501774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 752/1493] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:20.093635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:20.096032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:20.102524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:20.102971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:20.103728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:20.104162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:20.132462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f60ece61-ba33-445f-a8b7-cac9c58c65b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042771 Jul 29 06:37:20.133035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 742/1494] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:20.522281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:20.522825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:20.529472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:20.529924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:20.530685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:20.531122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:20.663948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:20.672105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a6a880a2-cfdd-4c83-8d45-b42ba0be03c8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153803 Jul 29 06:37:20.672692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 753/1495] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:21.146927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:21.149750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:21.156440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:21.156930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:21.157705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:21.158150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:21.186472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-325b49b9-4d6f-452d-97b3-3f7942aebef1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043603 Jul 29 06:37:21.187024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 743/1496] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:21.693597 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:21.694234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:21.701446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:21.701899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:21.702658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:21.703101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:21.830573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:21.838349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cd0e3b44-484c-4083-98c1-cd3e782b238a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148637 Jul 29 06:37:21.838914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 754/1497] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:22.199275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:22.201443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:22.208114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:22.208585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:22.209340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:22.209775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:22.238001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a0ec082e-4e32-493c-b14f-d55618e18832 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043247 Jul 29 06:37:22.238544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 744/1498] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:22.859571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:22.860181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:22.866692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:22.867139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:22.868170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:22.868650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:22.997131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:23.004564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-413ecc91-bace-4797-963d-854ed69302de tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148869 Jul 29 06:37:23.005143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 755/1499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:23.250176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:23.252313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:23.259014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:23.259467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:23.260240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:23.260722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:23.288865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73a92764-a385-4fb6-bb4b-1e563686adbd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042681 Jul 29 06:37:23.289411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 745/1500] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:24.026247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:24.026854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:24.033033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:24.033480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:24.034234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:24.034664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:24.164773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:24.172198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-54d0cab2-6011-4dd2-8b22-d44387277cb5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150407 Jul 29 06:37:24.172798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 756/1501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:24.301877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:24.303940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:24.312529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:24.313009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:24.313806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:24.314241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:24.346079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-03ad569a-1473-4d3e-9102-c08978186545 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048130 Jul 29 06:37:24.346683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 746/1502] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:24.631095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:24.631593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:24.637766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:24.638217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:24.639066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:24.639506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:24.641998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:25.193211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:25.193829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:25.200479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:25.200963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:25.201739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:25.202184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:25.328285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:25.336035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5fbc5aaa-c496-408e-ad51-bf476dfc7b0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146692 Jul 29 06:37:25.337123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 747/1503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:25.358539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:25.360703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:25.366525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:25.366978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:25.367872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:25.368274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:25.396002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-666b2a10-6e9c-4acc-9b34-6468171ff052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041170 Jul 29 06:37:25.396553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 748/1504] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:37:26.358606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:26.359291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:26.365689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:26.366137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:26.366899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:26.367338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:26.501552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:26.511379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2aef0414-4292-47c0-b5e7-dbc8572814ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156585 Jul 29 06:37:26.511948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 749/1505] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:26.516504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:26.518643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:26.525547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:26.526006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:26.526776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:26.527211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:26.556916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-917cafd9-2ac8-4dfa-9b67-ab21fd2442a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Jul 29 06:37:26.557461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 750/1506] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:27.532776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:27.533498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:27.540849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:27.541292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:27.542054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:27.542488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:27.670192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:27.677548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3f13924a-5212-459f-ad6a-604da3598aac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148643 Jul 29 06:37:27.678100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 751/1507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:27.682605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:27.684737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:27.690280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:27.690727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:27.691481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:27.691918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:27.721032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-faab810d-ad38-462c-8c6f-6c2508b1193a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041858 Jul 29 06:37:27.721588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 752/1508] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:28.698668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:28.699329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:28.705786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:28.706243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:28.707017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:28.707723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:28.836057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:28.844154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c99654d7-67df-4540-9dc7-c9e836a3a0d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149473 Jul 29 06:37:28.844783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 753/1509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:28.849270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:28.851412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:28.857787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:28.858239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:28.859009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:28.859454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:28.888140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2cae1840-8dcc-4057-8288-14c73eab9055 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042366 Jul 29 06:37:28.888714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 754/1510] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:29.865854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:29.866516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:29.873640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:29.874097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:29.874879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:29.875321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:29.877976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:30.010280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:30.017730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3075a396-a526-4659-a232-8cc07c60c0cc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155824 Jul 29 06:37:30.018294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 755/1511] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:30.022786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:30.025138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:30.030665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:30.031114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:30.031869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:30.032304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:30.061534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e184a73e-26ab-42a1-9e15-c497e2082985 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042262 Jul 29 06:37:30.062079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 756/1512] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:31.038777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:31.039388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:31.046449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:31.046901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:31.047665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:31.048130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:31.177962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:31.186007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-48d999ae-3600-4e27-9b9f-1493982dacf5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151145 Jul 29 06:37:31.186566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 757/1513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:31.191136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:31.193282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:31.199481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:31.199931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:31.200729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:31.201172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:31.231625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3eb290da-0c57-458d-b4b6-f8aefc5df0b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044070 Jul 29 06:37:31.232171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 758/1514] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:32.207803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:32.208452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:32.210758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=68 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:32.216877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:32.217321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:32.218077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:32.218510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:32.353856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:32.361467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a167774-5918-47a7-b1a5-9283603c7731 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157752 Jul 29 06:37:32.362031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 759/1515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:32.366522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:32.369260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:32.374976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:32.375436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:32.376200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:32.376665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:32.406495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5315df71-6cd1-480b-826b-e0ef254024a7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Jul 29 06:37:32.407045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 760/1516] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:33.383326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:33.384292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:33.390537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:33.390990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:33.391748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:33.392185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:33.520792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:33.529370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-850c0fdf-1f35-47da-b138-f9cc4c06d377 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150014 Jul 29 06:37:33.529960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 761/1517] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:33.534493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:33.536805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:33.543025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:33.543375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:33.544119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:33.544586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:33.574454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c3e3c49b-df1e-42ea-9f8f-87cfbefe4ee8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Jul 29 06:37:33.575004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 762/1518] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:34.551172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:34.551848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:34.559337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:34.559785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:34.560566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:34.561002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:34.635364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=43 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:34.659234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:34.694093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:34.702078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a18287ce-4bfc-4565-a8df-f1b3050a2426 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154858 Jul 29 06:37:34.702652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 763/1519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:34.707654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:34.709880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:34.715583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:34.716034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:34.716833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:34.717281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:34.748672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-03013b2a-5ae4-4915-b243-c2b7934495af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044955 Jul 29 06:37:34.749229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 764/1520] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:35.723667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:35.724297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:35.732137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:35.732608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:35.733425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:35.733786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:35.862716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:35.870488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3b5de775-f753-43d2-9cfb-9501437201a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150660 Jul 29 06:37:35.871048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 765/1521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:35.875512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:35.877674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:35.884028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:35.884491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:35.885284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:35.885724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:35.917423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2bab8879-18dc-45d0-8e86-91b085669556 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045386 Jul 29 06:37:35.917972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 766/1522] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:36.891224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:36.891896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:36.898348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:36.898804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:36.899575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:36.900015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:37.026097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:37.033784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3197a6d3-6eee-4986-ab7b-60b25c9d705a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146447 Jul 29 06:37:37.034348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 767/1523] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:37.039154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:37.042436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:37.048953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:37.049413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:37.050189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:37.050634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:37.080351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4ead8559-8ece-411c-903f-3f643b96a50b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Jul 29 06:37:37.080933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 768/1524] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:38.057764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:38.058433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:38.065122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:38.065573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:38.066335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:38.066774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:38.205588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:38.214194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9632cb31-6dd5-440d-bbf0-62c15ecc6794 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.160746 Jul 29 06:37:38.214757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 769/1525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:38.219242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:38.221410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:38.227925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:38.228390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:38.229217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:38.229667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:38.258975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ec195b0a-37e0-4a74-92d8-094b71b2f457 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042393 Jul 29 06:37:38.259622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 770/1526] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:39.236486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:39.237144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:39.244989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:39.245434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:39.246192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:39.246627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:39.374987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:39.377192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:39.383944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82b685f2-e7f3-4008-8f4b-31bda02d5249 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151312 Jul 29 06:37:39.384504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 771/1527] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:39.389363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:39.391488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:39.397212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:39.397664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:39.398432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:39.399610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:39.427952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c8cabc07-a4eb-47eb-86bf-cad9f0771cb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042334 Jul 29 06:37:39.428499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 772/1528] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:40.405052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:40.405719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:40.413228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:40.413684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:40.414619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:40.415071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:40.554627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:40.562899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2ef85ab-42db-4bd1-a2d1-2ecf67b8be84 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.161749 Jul 29 06:37:40.563461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 773/1529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:40.567929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:40.570071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:40.575949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:40.576393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:40.577184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:40.577617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:40.608380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-994964aa-bbcf-4b2c-89ff-7bc400a775fe tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Jul 29 06:37:40.608959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 774/1530] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:41.584100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:41.584752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:41.591802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:41.592257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:41.593058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:41.593501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:41.721214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:41.729000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-498767ea-c180-4b66-953b-f5ffb897938d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148968 Jul 29 06:37:41.729570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 775/1531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:41.734254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:41.736426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:41.743026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:41.743481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:41.744251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:41.744720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:41.773375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-79a1eaad-0a68-4d51-811a-f475008cdd08 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042813 Jul 29 06:37:41.774441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 776/1532] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:42.752218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:42.753070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:42.760222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:42.760721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:42.761493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:42.761926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:42.893453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:42.902012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85eff330-76c1-45f9-a8c5-f6ad556872c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154720 Jul 29 06:37:42.902570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 777/1533] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:42.907048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:42.909195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:42.915381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:42.915837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:42.916627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:42.917065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:42.944983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1d7515a-a4b5-4634-81da-2692917cad64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041394 Jul 29 06:37:42.946059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 778/1534] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:43.923328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:43.923980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:43.931021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:43.931469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:43.932235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:43.932701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:44.062640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:44.070118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3198fac8-0f5b-4ec5-a616-6e25d7076b62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150734 Jul 29 06:37:44.070821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 779/1535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:44.075260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:44.077390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:44.083244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:44.083691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:44.084440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:44.084909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:44.113900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-da7180c7-de31-4c1a-8adb-244405421d69 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042114 Jul 29 06:37:44.114437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 780/1536] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:45.091356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:45.092048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:45.098424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:45.098872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:45.099683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:45.100121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:45.226418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:45.234523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6a924137-10fa-4a97-a267-4e01e6c1d481 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.146972 Jul 29 06:37:45.235092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 781/1537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:45.239604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:45.241792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:45.248294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:45.248785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:45.249559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:45.250005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:45.279882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-17245b1c-f4e9-47ad-83b6-c5898a93c3b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043755 Jul 29 06:37:45.280432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 782/1538] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:46.256795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:46.257461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:46.264185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:46.264678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:46.265448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:46.265891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:46.401478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:46.409386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7461bd32-e5d7-4d26-8a83-749867b85b5b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156612 Jul 29 06:37:46.409957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 783/1539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:46.415211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:46.417377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:46.423075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:46.423522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:46.424288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:46.424771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:46.452712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b3245ec-7f46-466b-a307-52e667ef5131 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041647 Jul 29 06:37:46.453257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 784/1540] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:47.430393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:47.431063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:47.438577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:47.439028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:47.439792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:47.440233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:47.569724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:47.577433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4de69e91-7dfd-4778-abdf-f4c4b89fc173 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150883 Jul 29 06:37:47.577990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 785/1541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:47.582708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:47.584850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:47.591135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:47.591582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:47.592346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:47.592825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:47.621295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b2f9c56-2b93-49c4-a732-7c1176f2068f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042314 Jul 29 06:37:47.621825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 786/1542] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:48.599423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:48.600093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:48.607339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:48.607785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:48.608560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:48.608988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:48.740975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:48.748880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d8c4383-294f-4979-9033-060aef2a9627 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.153307 Jul 29 06:37:48.749442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 787/1543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:48.753918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:48.756037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:48.762561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:48.763016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:48.763788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:48.764227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:48.778608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:48.794240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f7e440c5-3535-4dfa-9abf-e9c076007a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043816 Jul 29 06:37:48.794791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 788/1544] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:49.770235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:49.770853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:49.778128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:49.778606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:49.779390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:49.779823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:49.907882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:49.915541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ab2374b-fc1c-4cb4-9a23-13c305bf0eed tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149134 Jul 29 06:37:49.916103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 789/1545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:49.920631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:49.922775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:49.928501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:49.928989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:49.930275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:49.930726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:49.961864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34f7e74e-6401-45b2-b117-8cb1b4fa7e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Jul 29 06:37:49.962428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 790/1546] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:50.936727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:50.937596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:50.943784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:50.944229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:50.945010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:50.946149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:51.077490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:51.085293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f583bb59-5e52-470e-81ea-2400ca002fab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152417 Jul 29 06:37:51.085855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 791/1547] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:51.090373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:51.092493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:51.098156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:51.098611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:51.099377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:51.099816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:51.129099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-31c0f5ef-2928-418f-9fc6-fa12e04a122f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042208 Jul 29 06:37:51.129645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 792/1548] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:52.106993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:52.107632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:52.114109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:52.114556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:52.115306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:52.115740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:52.244385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:52.251818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3dd5be67-7c6c-42e4-87aa-43c4f27df675 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148669 Jul 29 06:37:52.252379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 793/1549] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:52.256946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:52.260047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:52.265896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:52.266371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:52.267141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:52.267576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:52.298769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-38cc32bc-e0a6-4fa6-b530-efd612d06936 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Jul 29 06:37:52.299328 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 794/1550] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:53.275603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:53.276248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:53.282643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:53.283087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:53.283840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:53.284273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:53.411167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:53.419598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-490c403c-b32e-458d-a684-670817b453b1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148503 Jul 29 06:37:53.420167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 795/1551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:53.424821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:53.426967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:53.433631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:53.434103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:53.434865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:53.435296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:53.463531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c08e0f3e-c070-45f3-a9ed-0a0e7d5b1ccb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042263 Jul 29 06:37:53.464069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 796/1552] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:54.441608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:54.442257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:54.449500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:54.449951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:54.450711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:54.451155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:54.588445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:54.595847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4b4ab9ea-b288-4122-a1df-ced6ae810463 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.158199 Jul 29 06:37:54.596410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 797/1553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:54.600892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:54.603569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:54.609266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:54.609714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:54.610471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:54.610903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:54.639194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b6a7a253-c825-4a57-9ac4-073a9cb4e3d3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041786 Jul 29 06:37:54.639727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 798/1554] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:55.617805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:55.618498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:55.625270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:55.625715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:55.626475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:55.626908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:55.757601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:55.765342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a30f9504-e90c-49f6-8642-92ebdb410de7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151956 Jul 29 06:37:55.765904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 799/1555] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:55.770342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:55.772497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:55.778248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:55.778702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:55.779459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:55.779896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:55.809008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-352830f5-d656-4bf1-96b7-1934fd46e080 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042087 Jul 29 06:37:55.809552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 800/1556] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:56.787129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:56.787756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:56.794264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:56.794694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:56.795448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:56.795877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:56.927029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:56.935497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-803e4945-537a-4897-8588-2da970a0e302 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152775 Jul 29 06:37:56.936092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 801/1557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:37:56.940637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:56.942739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:56.949072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:56.949517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:56.950274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:56.950710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:56.979587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eba2eb42-a14a-4cd0-98c8-45eb987dc3b0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042459 Jul 29 06:37:56.980120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 802/1558] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:57.957092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:57.958006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:57.964617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:57.965541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:57.966303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:57.966732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:58.099676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:58.108076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-60c9b7b6-ed68-4874-8c85-9c21ab496002 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154837 Jul 29 06:37:58.108667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 803/1559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:58.113169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:58.115277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:58.120886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:58.121336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:58.122091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:58.122524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:58.150710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c9a58e3-f539-4469-a6fb-58201eff463c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041069 Jul 29 06:37:58.151237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 804/1560] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:37:59.129182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:59.129836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:59.137171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:59.137624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:59.138384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:59.138824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:59.142722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:37:59.266775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:37:59.274375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-117735d8-7895-4378-90d6-a357eabcce6c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149045 Jul 29 06:37:59.274944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 805/1561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:37:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:37:59.279527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:37:59.281677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:37:59.287539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:59.287993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:59.288804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:37:59.289864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:37:59.318580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2be16cd5-e43d-4a92-a05b-7b96b39fc254 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042652 Jul 29 06:37:59.319130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 806/1562] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:37:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:00.295468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:00.296112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:00.302897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:00.303353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:00.304118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:00.304634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:00.439938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:00.448179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d434f7b3-352e-4675-8f8f-4496702b16db tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.156607 Jul 29 06:38:00.448782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 807/1563] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:00.453258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:00.455399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:00.461354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:00.461799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:00.462587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:00.463007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:00.491127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-202009d3-c458-48ae-90e0-166daf89807e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041347 Jul 29 06:38:00.491673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 808/1564] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:01.469568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:01.470238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:01.472479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:38:01.478766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:01.479219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:01.479988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:01.480430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:01.610255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:01.618170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-129e15b2-9c41-427a-ac3f-feb8720c1c70 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152337 Jul 29 06:38:01.618738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 809/1565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:01.623265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:01.625490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:01.631198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:01.631656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:01.632425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:01.633572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:01.661709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0be6d66d-dc99-4982-8b82-4ec932836045 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041978 Jul 29 06:38:01.662248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 810/1566] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:02.639532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:02.640192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:02.646704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:02.647153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:02.647915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:02.648797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:02.783005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:02.790646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10098296-efb4-4d00-a66e-9c2c36c3e2e7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155015 Jul 29 06:38:02.791206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 811/1567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:02.795663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:02.797785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:02.803435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:02.803887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:02.805278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:02.805710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:02.833742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34320be0-490f-4ca8-b142-c260ec5725e5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041565 Jul 29 06:38:02.834285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 812/1568] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:03.812060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:03.812684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:03.819126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:03.819573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:03.820556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:03.821073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:03.950396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:03.958110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-52c25ce3-70fc-452f-8468-15e4f76931f3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149759 Jul 29 06:38:03.958663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 813/1569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:03.963176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:03.965322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:03.970932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:03.971382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:03.972146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:03.972608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:04.001095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c02e76c8-b4dd-4724-86ca-cbd49ee8dc72 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041456 Jul 29 06:38:04.001633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 814/1570] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:04.979197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:04.979856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:04.986359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:04.986753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:04.987517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:04.987959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:05.121773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:05.129211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-30ddafbc-230d-4b7a-8989-b7ab394234ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.154405 Jul 29 06:38:05.129775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 815/1571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:05.134812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:05.136940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:05.142496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:05.142949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:05.143702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:05.144132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:05.171822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f63c826-1d45-41bb-b1b4-ff4c956da662 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041083 Jul 29 06:38:05.172348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 816/1572] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:06.151313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:06.151993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:06.158402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:06.158843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:06.159590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:06.160022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:06.288005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:06.295581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-11bbe75d-38f1-48e8-8a5c-605dbe3fcaaf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148662 Jul 29 06:38:06.296142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 817/1573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:06.300743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:06.302877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:06.308630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:06.309091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:06.309865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:06.310310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:06.339909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-33549730-5edf-4eb6-8ed6-362089d0bd4f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 Jul 29 06:38:06.340462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 818/1574] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:07.316781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:07.317436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:07.324645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:07.325094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:07.325851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:07.326280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:07.454383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:07.462253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-095019e5-6ec7-4930-a209-c22c0a155a4f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.149490 Jul 29 06:38:07.462817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 819/1575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:07.467375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:07.469542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:07.475182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:07.475633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:07.477121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:07.477744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:07.506914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e296dc4a-dbbd-498b-92e3-a8e696cddc1c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043075 Jul 29 06:38:07.507504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 820/1576] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:08.483287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:08.483959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:08.490376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:08.490820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:08.491579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:08.492167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:08.625812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:08.628027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:38:08.634861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8f36ba8b-5db6-48af-9da9-45fb2f8215e1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.155409 Jul 29 06:38:08.635420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 821/1577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:08.639983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:08.642213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:08.648410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:08.648892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:08.649650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:08.650084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:08.678859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f4ededa-6575-413e-abe3-af28cf361f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042389 Jul 29 06:38:08.679861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 822/1578] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:09.655400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:09.656009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:09.662617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:09.663056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:09.664514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:09.664983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:09.795359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:09.802897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c117d00-7266-4be8-aeee-7a590f070d85 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151405 Jul 29 06:38:09.803461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 823/1579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:09.808166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:09.810380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:09.816018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:09.816475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:09.817282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:09.817722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:09.847366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5671e75-a9bb-44af-b84c-2e4ab05bc55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042913 Jul 29 06:38:09.847910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 824/1580] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:10.824247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:10.824912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:10.831319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:10.831763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:10.832515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:10.833232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:10.965710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:10.973107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a243121f-51c8-446c-8956-456ec7fdd63a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.152913 Jul 29 06:38:10.973666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 825/1581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:10.978298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:10.980399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:10.986176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:10.986565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:10.987322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:10.987759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:11.016918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-405ca465-54c4-4880-a724-19db276b02b7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042095 Jul 29 06:38:11.017459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 826/1582] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:11.995044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:11.995658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:12.002270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:12.002722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:12.003490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:12.003931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:12.131060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:12.139000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-86b85737-8e94-429d-b884-a0fc3bbdd17a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148581 Jul 29 06:38:12.139565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 827/1583] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:12.144022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:12.146263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:12.152618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:12.153078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:12.153843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:12.154286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:12.182595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dc9985c3-6aa4-4116-8cc0-b3fc249ce2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042051 Jul 29 06:38:12.183135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 828/1584] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:13.160893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:13.161542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:13.168088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:13.168553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:13.169321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:13.169754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:13.297515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:13.305667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d99f0c0-a5ec-443d-8f2c-f0490152e730 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.148630 Jul 29 06:38:13.306220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 829/1585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:13.310752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:13.312883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:13.318477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:13.318925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:13.319685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:13.320880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:13.348745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-89681037-e95b-4e7f-83b4-a5750c6a2b78 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041509 Jul 29 06:38:13.349290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 830/1586] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:14.327043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:14.327800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:14.334532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:14.334981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:14.336402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:14.336987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:14.473432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:14.481008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a08294e2-8e46-4e76-8ce0-c10e7eaf4aca tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157825 Jul 29 06:38:14.481734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 831/1587] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:14.486548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:14.488958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:14.494923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:14.495410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:14.496177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:14.496662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:14.526063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-69d68f22-7c8d-4e19-a7c2-0ad4aebe4436 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043094 Jul 29 06:38:14.526615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 832/1588] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:15.502213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:15.502906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:15.509459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:15.509908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:15.510669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:15.511108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:15.641231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:15.649228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-99d4f28e-84b1-415e-8f5a-410409ffe689 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.150905 Jul 29 06:38:15.649790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 833/1589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:15.654249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:15.656364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:15.661978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:15.662429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:15.663185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:15.664255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:15.692146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cde252d2-4162-41ce-97cd-41e14acff046 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041382 Jul 29 06:38:15.692707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 834/1590] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 06:38:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:16.670010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:16.670714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:16.677183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:16.677631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:16.678392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:16.678829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:16.816213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:16.823984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-459d79e9-7fc5-40a8-b14f-ca56bc3283e9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.157801 Jul 29 06:38:16.824555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 835/1591] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:16.829059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:38:16.831209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:16.837870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:16.838321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:16.839085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:16.839525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:16.920299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8aab7730-bfc0-4458-b396-b2e33e5c995e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/action" status: 200 len: 76853 microversion: 2.1 time: 0.094380 Jul 29 06:38:16.920904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 836/1592] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 06:38:16 2022] POST /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c/action => generated 76853 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:38:17.846836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:17.847543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:17.855521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:17.855968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:17.856798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:17.857229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:17.986312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:17.994438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a0c75666-a935-4bf4-9279-fecc963ada6d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151889 Jul 29 06:38:17.994998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 837/1593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:19.015210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:19.015837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:19.022353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:19.022809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:19.023582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:19.024019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:19.153624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:19.155904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:38:19.162330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8b90b83e-aef7-4b84-926b-ccf7259f651a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.151082 Jul 29 06:38:19.162884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 838/1594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:20.228276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:20.228920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:20.235386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:20.235834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:20.236616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:20.237052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:20.263797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:38:20.342997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12d7bc30-8432-46f3-9d88-4792fa23d0e2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 204 len: 0 microversion: 2.1 time: 0.118945 Jul 29 06:38:20.343789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 839/1595] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:38:20 2022] DELETE /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:38:20.419070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-13413a78-3f06-48e8-a32a-ab71da9dc4b5 req-a54d6240-1881-421e-906f-8130bdc50e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0edc82ad-0d5b-4b12-b5fa-e69548ffd732", "tag": "7771fb54-6e8f-4267-8251-b0e5ae9ed6bb"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:38:20.428514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-13413a78-3f06-48e8-a32a-ab71da9dc4b5 req-a54d6240-1881-421e-906f-8130bdc50e8b service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:20.428948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-13413a78-3f06-48e8-a32a-ab71da9dc4b5 req-a54d6240-1881-421e-906f-8130bdc50e8b service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:20.440593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-13413a78-3f06-48e8-a32a-ab71da9dc4b5 req-a54d6240-1881-421e-906f-8130bdc50e8b service nova] Creating event network-changed:7771fb54-6e8f-4267-8251-b0e5ae9ed6bb for instance 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 on hv-cinder-83482 Jul 29 06:38:20.446516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-13413a78-3f06-48e8-a32a-ab71da9dc4b5 req-a54d6240-1881-421e-906f-8130bdc50e8b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100892 Jul 29 06:38:20.447288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 840/1596] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:38:20.452296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:20.452862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:20.459393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:20.459878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:20.460945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:20.461513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:20.670065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:20.678170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eca56d95-9720-4508-ab0e-e8afd92ba5ff tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1570 microversion: 2.1 time: 0.229697 Jul 29 06:38:20.678976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 841/1597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1570 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:38:21.699234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:21.699872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:21.707198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:21.707649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:21.708692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:21.709127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:21.842652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:21.850181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1c42c7ed-fc77-42dc-a290-06bf688d9bb4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154771 Jul 29 06:38:21.850738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 842/1598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:22.871578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:22.872237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:22.878763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:22.879215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:22.879980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:22.880423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:23.011377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:23.018811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-35835645-c5b4-4227-a135-ff6df91802a7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151161 Jul 29 06:38:23.019378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 843/1599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:24.039521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:24.040193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:24.046925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:24.047372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:24.048132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:24.048584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:24.176368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:38:24.183859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bb2edbe3-718c-40da-899f-9f2b97219607 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148183 Jul 29 06:38:24.184418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 844/1600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:38:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:38:24.757548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:38:24.758068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:38:24.764093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:24.764564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:24.765339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:38:24.765803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:38:31.476779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lazy-loading 'services' on Instance uuid 862582d7-9f21-4209-b495-59dfe7509df0 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:38:31.646615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lazy-loading 'services' on Instance uuid 862582d7-9f21-4209-b495-59dfe7509df0 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:38:32.823623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:38:32.824105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:38:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 (ip 10.222.0.33) !!! Jul 29 06:38:34.762337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:38:39.579006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:38:39.579408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:38:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 (ip 10.222.0.33) !!! Jul 29 06:38:41.480880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=4 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:38:41.650360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:39:24.851417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8e8915be-40c0-4a94-bdcb-5f5236595640 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8" status: 202 len: 0 microversion: 2.1 time: 120.223921 Jul 29 06:39:24.852080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 757/1601] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:37:24 2022] DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 => generated 0 bytes in 120226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:39:24.874326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Request method failure captured: Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 HTTP/1.1 Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4339VGeUJG7YrxaGwlpu7_ElY95VP0bZOpOFgYQXiqfGwl7EzcV6jMD8j-Jmhd6DbjGZJ---rGo-hjy2Yd_8-6CtFHybCf7Cd6UeP4xuEkvcaACVqsvra5GcRwUgBUr72x3Q8u8bBLmN87jg1YTkl_vVhMAsFPPbdGX52E0CCd93QzM Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:39:24.876655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_002000e5606c46c29c87b0fa2fe68b3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 5e05c9bdfc114478b5d80f077b970d17 Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:39:24.878249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'server_id': '862582d7-9f21-4209-b495-59dfe7509df0', 'id': '8c07dc3b-d032-4343-a61e-d874a8fb99e8'} Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:39:24.879205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:39:24.883788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:24.887283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:39:24.889913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) Jul 29 06:39:24.894841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:39:24.897366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d09eea0f-9614-4e29-b458-7a376f14a91b) {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:39:24.897366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8f44c01-d664-4c48-9c01-08c4b7b6349b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8" status: 400 len: 269 microversion: 2.1 time: 60.190572 Jul 29 06:39:24.897366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 845/1602] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:38:24 2022] DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 => generated 269 bytes in 60192 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 29 06:39:24.897366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:24.898010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:24.906893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:24.907309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:24.908755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:24.909283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:24.938825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:39:24.957163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:24.958235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:24.973962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:24.974520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:24.975705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:24.976577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:25.026174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e14bdbe3-b9ea-4139-bca4-6110fc5d1080 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 204 len: 0 microversion: 2.1 time: 0.145846 Jul 29 06:39:25.027226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 846/1603] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:39:24 2022] DELETE /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:39:25.032491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:25.033093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:25.039103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:25.039594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:25.040377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:25.040881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:25.114143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:25.121871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d1555ede-6c02-4b2f-b8e7-e19bc770e106 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.268427 Jul 29 06:39:25.122442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 758/1604] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:39:25.126823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:25.127448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:25.133624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:25.134078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:25.134840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:25.135279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:25.265382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:25.273688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-374f61da-9be6-488f-ac11-50ce31865b71 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1671 microversion: 2.1 time: 0.150274 Jul 29 06:39:25.274253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 759/1605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:25 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:39:26.143372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:26.144024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:26.151678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:26.152131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:26.152993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:26.153458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:26.303831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:26.312963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-424a5cd6-d4fe-4537-bcbf-3f106d189ffa tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.173435 Jul 29 06:39:26.313550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 760/1606] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:26.318317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-3e4dd606-db21-4109-b550-a9fdf8a86095 req-c8e2f160-b816-4080-aeab-65597e8df168 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1670afa-b434-47b5-a7d8-88464f5bd861", "name": "network-vif-deleted", "tag": "06633a8c-27ad-4ecc-9347-65119140506f"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:39:26.328485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3e4dd606-db21-4109-b550-a9fdf8a86095 req-c8e2f160-b816-4080-aeab-65597e8df168 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:26.328965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3e4dd606-db21-4109-b550-a9fdf8a86095 req-c8e2f160-b816-4080-aeab-65597e8df168 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:26.343009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-3e4dd606-db21-4109-b550-a9fdf8a86095 req-c8e2f160-b816-4080-aeab-65597e8df168 service nova] Creating event network-vif-deleted:06633a8c-27ad-4ecc-9347-65119140506f for instance c1670afa-b434-47b5-a7d8-88464f5bd861 on hv-cinder-83482 Jul 29 06:39:26.352462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-3e4dd606-db21-4109-b550-a9fdf8a86095 req-c8e2f160-b816-4080-aeab-65597e8df168 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036920 Jul 29 06:39:26.353477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 761/1607] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:39:26.360136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:26.360880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:26.370105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:26.370909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:26.372389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:26.373047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:26.421300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:26.421773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:26.422189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lazy-loading 'fault' on Instance uuid c1670afa-b434-47b5-a7d8-88464f5bd861 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:39:26.466911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1b9767f26254a6cba945f4cae562b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b773b1bba540f79c21b042d5cf91de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:26.474767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f0b3f3f4-4f6b-4567-be92-6795f44bbfe8 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 200 len: 1326 microversion: 2.1 time: 0.118799 Jul 29 06:39:26.476389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 762/1608] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:26 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 1326 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:39:27.337744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:27.338223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:27.344695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:27.345157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:27.346089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:27.346530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:27.481556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:27.488968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c18481f-a765-4317-937a-8886a4791470 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.158153 Jul 29 06:39:27.489529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 763/1609] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:27.496390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:27.497137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:27.502831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:27.503281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:27.504040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:27.504479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:27.517856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] HTTP exception thrown: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Request method failure captured: Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 HTTP/1.1 Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432fxti8pbSYNfIk9o3lK909ucRXvyHrKqmpzH9oVvs2UiIFjuM9RqA0LRKHJmDJki-jYaMr1eW0A7kaPPUOrHe5w0hKPz02vAQrlHG--dcHNwUWwC56fAw_IhnWIDsRH69WhGM9qDTfRMslQNBnMWUE6fnuZ8CgyqP4ABLUZUUeC2c Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:39:27.519481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3b773b1bba540f79c21b042d5cf91de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: e1b9767f26254a6cba945f4cae562b70 Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:39:27.521017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'c1670afa-b434-47b5-a7d8-88464f5bd861'} Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:39:27.521929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:39:27.523897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:39:27.525227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Returning 404 to user: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:39:27.525227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-04eb82f8-75dd-4d65-ad94-0e8723f91b75 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 404 len: 111 microversion: 2.1 time: 0.028138 Jul 29 06:39:27.525227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 764/1610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:27 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 06:39:27.529875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6db0d344-e623-4838-8c50-0fcf2d390227 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '.version_select at 0x7f145e2ff310>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:27.551719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6db0d344-e623-4838-8c50-0fcf2d390227 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-668177473" status: 202 len: 0 microversion: 2.1 time: 0.025238 Jul 29 06:39:27.552272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 765/1611] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Jul 29 06:39:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-668177473 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 06:39:28.511034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:28.511683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:28.518284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:28.518728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:28.519483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:28.519919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:28.652268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:28.659837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0a356005-904b-42a6-beea-45934edded6b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154070 Jul 29 06:39:28.660409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 766/1612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:29.680037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:29.680768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:29.687226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:29.687676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:29.688442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:29.688904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:29.820211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:29.827648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8c848c67-5271-4763-80c2-19751f958c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151501 Jul 29 06:39:29.828210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 767/1613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:30.848723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:30.849379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:30.855774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:30.856222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:30.857123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:30.857556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:30.991190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:30.998959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eb13bcd9-81c3-4b9b-adec-25cf5b3ede1c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154079 Jul 29 06:39:30.999522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 768/1614] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:32.020712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:32.021349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:32.027750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:32.028200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:32.028984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:32.029419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:32.157289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:32.165276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5e6f0748-513b-4f2f-a9c1-cddb4e20f45f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148654 Jul 29 06:39:32.165832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 769/1615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:33.186568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:33.187225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:33.193857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:33.194413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:33.195189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:33.195604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:33.326999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:33.335560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1e3799be-eeb5-4ef3-ae2e-aa5b55842171 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152831 Jul 29 06:39:33.336121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 770/1616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:34.356280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:34.357001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:34.363429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:34.363883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:34.364678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:34.365119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:34.498148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:34.505505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b41b315e-54eb-4a4d-9bfd-f26878aa2fc3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153125 Jul 29 06:39:34.506629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 771/1617] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:35.036649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:39:35.060491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:39:35.527344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:35.527975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:35.534475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:35.534930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:35.535709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:35.536144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:35.666340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:35.673809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-34de778b-9f0e-4c12-9f37-af6fb3a96d14 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150346 Jul 29 06:39:35.674372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 772/1618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:36.696729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:36.697633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:36.704189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:36.704672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:36.705435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:36.705870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:36.844203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:36.851771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7caa738c-dd2c-40f7-90aa-5f1f21bc61a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.160223 Jul 29 06:39:36.852361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 773/1619] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:37.873389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:37.873996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:37.880312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:37.880786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:37.881549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:37.881980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:38.013133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:38.020437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b0a58e9-5351-4723-b4de-776809623672 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151279 Jul 29 06:39:38.021015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 774/1620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:39.042238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:39.042855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:39.049336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:39.049787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:39.050542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:39.050976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:39.182517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:39.189922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eae3c2da-7e60-48cb-bf90-3f8735366d20 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152047 Jul 29 06:39:39.190480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 775/1621] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:40.212154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:40.212827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:40.219211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:40.219656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:40.220407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:40.220887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:40.224901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:39:40.348775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:40.356120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b0fbfece-b848-4ff5-8e88-7b01f42d0ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148763 Jul 29 06:39:40.356701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 776/1622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:41.377276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:41.378048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:41.385226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:41.385682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:41.386451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:41.386892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:41.514967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:41.522476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8557d75-0d46-4ef4-8ee9-4313ccd4f49b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149069 Jul 29 06:39:41.523203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 777/1623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:42.544582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:42.545633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:42.552673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:42.553122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:42.553879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:42.554321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:42.693723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:42.702097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7a6dcc65-e615-4e82-b66a-349397816822 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.162260 Jul 29 06:39:42.702660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 778/1624] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:43.723150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:43.723774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:43.730948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:43.731390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:43.732149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:43.732598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:43.862197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:43.869680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-40468431-c6f9-4dcc-87f4-e7a7aeaaeb0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150440 Jul 29 06:39:43.870234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 779/1625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:44.890918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:44.891588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:44.899691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:44.900148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:44.900949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:44.901397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:45.033103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:45.040639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8aab05b5-b8ed-4ecb-8325-878dcbf9ceba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153539 Jul 29 06:39:45.041199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 780/1626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:46.060937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:46.061568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:46.067949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:46.068398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:46.069196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:46.070077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:46.207179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:46.215829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4e3bd54b-6381-4379-bd26-f5d197cb91d5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.158939 Jul 29 06:39:46.216395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 781/1627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:47.237212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:47.237895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:47.245051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:47.245496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:47.246246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:47.246677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:47.376381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:47.384102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-23503702-4a48-4a0f-9838-1b7fad3b0afe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150745 Jul 29 06:39:47.384688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 782/1628] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:48.404744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:48.405395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:48.411771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:48.412217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:48.413004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:48.413496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:48.546001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:48.554011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4127436c-8e6b-4a81-8009-f3dca5f7ce13 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153107 Jul 29 06:39:48.554588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 783/1629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:49.575302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:49.575947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:49.582332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:49.582785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:49.583541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:49.583978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:49.717373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:49.724907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ef1056c2-70a1-46cb-a8b6-09666f5045f9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153503 Jul 29 06:39:49.725478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 784/1630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:39:50.747223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:50.747847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:50.754410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:50.754881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:50.755650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:50.756092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:50.893869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:50.901414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-89f40bc9-76e9-460b-b7af-4bdd67f1c4f2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.158457 Jul 29 06:39:50.901978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 785/1631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:51.928085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:51.929294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:51.935958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:51.936406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:51.937180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:51.937612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:52.066294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:52.073807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d2879ba3-d86a-44d2-9a7f-96cda10a4983 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149558 Jul 29 06:39:52.074367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 786/1632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:53.095723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:53.096332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:53.103554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:53.104000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:53.104793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:53.105227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:53.238410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:53.246694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-63bd832a-cdd9-4cba-ab2b-20ea563b9848 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154955 Jul 29 06:39:53.247252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 787/1633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:39:54.267040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:54.267708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:54.274598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:54.275043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:54.275794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:54.276223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:54.407161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:54.414917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f90a426-6421-407d-bfd2-1b6ad0005dbe tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151953 Jul 29 06:39:54.415468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 788/1634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:54.431536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:39:54.432036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:39:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 (ip 10.222.0.33) !!! Jul 29 06:39:55.436144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:55.436783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:55.439065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:39:55.444377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:55.444855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:55.445731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:55.446189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:55.577114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:55.585097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8e89ca53-8996-4c07-8491-a6da9a7f73a9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152812 Jul 29 06:39:55.585650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 789/1635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:56.607190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:56.607884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:56.614251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:56.614698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:56.615451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:56.615879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:56.750406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:56.757888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ef3e1232-ad25-4b15-9888-0db1870beeec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154689 Jul 29 06:39:56.759170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 790/1636] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:57.779684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:57.780287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:57.786896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:57.787345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:57.788126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:57.788577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:57.916201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:57.923593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-25e510c0-ab56-448f-b3f6-c5e791233ed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.147721 Jul 29 06:39:57.924153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 791/1637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:39:58.944466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:39:58.945162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:39:58.952087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:58.952532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:58.953327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:39:58.953759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:39:59.085134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:39:59.089183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:39:59.093948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-99a024ad-716d-4e01-9f36-09976bf0c170 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153347 Jul 29 06:39:59.094513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 792/1638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:39:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:00.115328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:00.115969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:00.122831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:00.123288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:00.124057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:00.124496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:00.253462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:00.260979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8f8e3b7e-dd80-43d6-a3ea-a68bc6a174a6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149515 Jul 29 06:40:00.261546 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 793/1639] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:01.283562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:01.284244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:01.291131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:01.291582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:01.292340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:01.292807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:01.422892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:01.430752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d83ec703-b142-4142-9809-f63b8445e59a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150861 Jul 29 06:40:01.431327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 794/1640] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:02.450816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:02.451507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:02.457879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:02.458325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:02.459075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:02.459771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:02.593110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:02.600735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-827ad3ca-9f9a-4ab8-a48e-a933ff6a00d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153758 Jul 29 06:40:02.601297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 795/1641] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:03.622862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:03.623533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:03.630023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:03.631005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:03.631227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:03.631669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:03.759973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:03.767327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d5cc1e66-4e8e-4861-9d9c-29d16d6999b2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148333 Jul 29 06:40:03.767883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 796/1642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:04.788772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:04.790209 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:04.796814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:04.797266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:04.798026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:04.798460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:04.931553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:04.942253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-37a4df3b-38ba-4d39-a015-11cf7b8abeda tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.157010 Jul 29 06:40:04.943284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 797/1643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:05.965942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:05.966569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:05.973462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:05.973916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:05.974673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:05.975107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:06.102424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:06.109724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d2b598a1-e8e4-4df5-983f-a481e68ab163 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148888 Jul 29 06:40:06.110284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 798/1644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:07.130174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:07.130827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:07.137961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:07.138411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:07.139178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:07.139620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:07.274441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:07.281951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-db75b15d-aca3-4db8-a008-eedcd3d8841d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.155667 Jul 29 06:40:07.282521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 799/1645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:08.303152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:08.303851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:08.310736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:08.311190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:08.311952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:08.312387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:08.444185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:08.451631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cb64e4ce-c549-4377-9fc4-d5dec5d3e69d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152329 Jul 29 06:40:08.452188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 800/1646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:09.473233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:09.473907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:09.480567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:09.481001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:09.481750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:09.482181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:09.610748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:09.618350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-15f897f9-d907-4494-a162-5717e2a2ca11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148933 Jul 29 06:40:09.618926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 801/1647] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:10.639363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:10.640014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:10.646580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:10.647036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:10.647798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:10.648243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:10.780211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:10.787602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a58e5532-5ec1-4222-9159-8518bf872ee8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152065 Jul 29 06:40:10.788161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 802/1648] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:11.809287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:11.809918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:11.816353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:11.816840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:11.817610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:11.818060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:11.950443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:11.957821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eea68b4b-9582-4807-8af6-fc4754b46c8c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153023 Jul 29 06:40:11.958378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 803/1649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:12.979966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:12.980664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:12.987191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:12.987575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:12.988327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:12.988791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:13.121608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:13.128933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f1b1e006-c556-426d-ba22-28a3b22678c2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153542 Jul 29 06:40:13.129493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 804/1650] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:14.150924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:14.151598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:14.158158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:14.158612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:14.159382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:14.159830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:14.288308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:14.295791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-970072e9-ebb5-4bbd-872f-244e3ea3abf4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149459 Jul 29 06:40:14.296354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 805/1651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:15.317180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:15.317853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:15.324315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:15.324790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:15.325548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:15.325974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:15.459102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:15.467494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f2d7ae8b-1455-4621-a601-1146d4857167 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154164 Jul 29 06:40:15.468057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 806/1652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:16.488900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:16.489659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:16.497123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:16.497572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:16.498341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:16.498773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:16.639994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:16.647950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-797aa43a-3e0d-47f1-abdb-c02eb710234c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.162915 Jul 29 06:40:16.648515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 807/1653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:17.670256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:17.670909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:17.677385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:17.677846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:17.678619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:17.679064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:17.807276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:17.814732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e34e316b-056a-4a91-b7fb-41bc296ec2be tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148323 Jul 29 06:40:17.815297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 808/1654] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:18.835657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:18.836818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:18.843282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:18.843727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:18.844478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:18.844932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:18.862895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:40:18.978864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:18.986562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-56e96aa9-966f-4060-9849-34ecb75f108d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154901 Jul 29 06:40:18.987054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 809/1655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:20.007372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:20.008009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:20.014529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:20.014978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:20.015734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:20.016162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:20.142624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:20.150200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5b5f999f-3faf-45e4-a965-d351fce002c0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.146709 Jul 29 06:40:20.150754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 810/1656] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:21.171540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:21.172207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:21.178666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:21.179111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:21.179865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:21.180423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:21.310528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:21.317857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2abc53ed-834a-4ae3-8fc1-fd854836b346 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150178 Jul 29 06:40:21.318411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 811/1657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:40:22.340038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:22.340755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:22.347477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:22.347936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:22.348723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:22.349153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:22.480619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:22.488055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-71f10348-6305-420d-a3fc-6a23a4b26dbb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152478 Jul 29 06:40:22.488647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 812/1658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:23.509107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:23.509788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:23.516366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:23.516858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:23.517626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:23.518066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:23.647927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:23.655780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5481f2e8-089a-4f15-a9a6-42f7e9433af7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150569 Jul 29 06:40:23.656342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 813/1659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:24.677547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:24.678254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:24.684848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:24.685304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:24.686074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:24.686514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:24.819558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:40:24.827068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7d49c745-df9b-4c4c-8e5c-95a4d1162755 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153409 Jul 29 06:40:24.827628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 814/1660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:40:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:40:24.832254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:40:24.832778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:40:24.839290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:24.839742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:24.840501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:40:24.840963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:40:31.403675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:40:31.404263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:40:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 (ip 10.222.0.33) !!! Jul 29 06:40:31.797855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lazy-loading 'services' on Instance uuid 862582d7-9f21-4209-b495-59dfe7509df0 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:40:31.953753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lazy-loading 'services' on Instance uuid 862582d7-9f21-4209-b495-59dfe7509df0 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:40:34.837150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=53 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:40:41.801893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:40:41.958688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=40 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:41:25.080721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Request method failure captured: Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 HTTP/1.1 Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi4339VGeUJG7YrxaGwlpu7_ElY95VP0bZOpOFgYQXiqfGwl7EzcV6jMD8j-Jmhd6DbjGZJ---rGo-hjy2Yd_8-6CtFHybCf7Cd6UeP4xuEkvcaACVqsvra5GcRwUgBUr72x3Q8u8bBLmN87jg1YTkl_vVhMAsFPPbdGX52E0CCd93QzM Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:41:25.083120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_002000e5606c46c29c87b0fa2fe68b3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 5e05c9bdfc114478b5d80f077b970d17 Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:41:25.084480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'server_id': '862582d7-9f21-4209-b495-59dfe7509df0', 'id': '8c07dc3b-d032-4343-a61e-d874a8fb99e8'} Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:41:25.085773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:41:25.088861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.092422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:41:25.094459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) Jul 29 06:41:25.097458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.100329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a20aeed7-0894-4c58-8848-1195e0ac692b) {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:41:25.100329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e733b03f-3d81-420c-a92a-a10a49c25b0f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8" status: 400 len: 269 microversion: 2.1 time: 120.056183 Jul 29 06:41:25.100329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 847/1661] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:39:25 2022] DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 => generated 269 bytes in 120057 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:41:25.100329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:25.101029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:25.102147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:25.103288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:25.104325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:25.104802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:25.119717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Request method failure captured: Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 HTTP/1.1 Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi4339VGeUJG7YrxaGwlpu7_ElY95VP0bZOpOFgYQXiqfGwl7EzcV6jMD8j-Jmhd6DbjGZJ---rGo-hjy2Yd_8-6CtFHybCf7Cd6UeP4xuEkvcaACVqsvra5GcRwUgBUr72x3Q8u8bBLmN87jg1YTkl_vVhMAsFPPbdGX52E0CCd93QzM Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:41:25.123127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_002000e5606c46c29c87b0fa2fe68b3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 5e05c9bdfc114478b5d80f077b970d17 Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:41:25.124433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'server_id': '862582d7-9f21-4209-b495-59dfe7509df0', 'id': '8c07dc3b-d032-4343-a61e-d874a8fb99e8'} Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:41:25.125110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:41:25.126150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.128491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:41:25.130576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) Jul 29 06:41:25.133207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.135805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-def9aafb-94c3-4810-9842-d3ce16074b8e) {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:41:25.135805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2f1ebdca-6c3b-4c98-ad36-445eb1882415 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8" status: 400 len: 269 microversion: 2.1 time: 60.296004 Jul 29 06:41:25.135805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 815/1662] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:40:24 2022] DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 => generated 269 bytes in 60297 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:41:25.135805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:25.136911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:25.140421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:25.140922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:25.141828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:25.142383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:25.245932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:25.253479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c7bed9d-f51a-4541-b4a0-ed771d353e03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.167178 Jul 29 06:41:25.254228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 848/1663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:25.303631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lazy-loading 'services' on Instance uuid 862582d7-9f21-4209-b495-59dfe7509df0 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:41:25.359188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Request method failure captured: Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 HTTP/1.1 Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi4339VGeUJG7YrxaGwlpu7_ElY95VP0bZOpOFgYQXiqfGwl7EzcV6jMD8j-Jmhd6DbjGZJ---rGo-hjy2Yd_8-6CtFHybCf7Cd6UeP4xuEkvcaACVqsvra5GcRwUgBUr72x3Q8u8bBLmN87jg1YTkl_vVhMAsFPPbdGX52E0CCd93QzM Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:41:25.361366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_002000e5606c46c29c87b0fa2fe68b3c", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/002000e5606c46c29c87b0fa2fe68b3c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 002000e5606c46c29c87b0fa2fe68b3c Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-307604271 Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 5e05c9bdfc114478b5d80f077b970d17 Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-VolumesSnapshotTestJSON-307604271-project Jul 29 06:41:25.362892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'server_id': '862582d7-9f21-4209-b495-59dfe7509df0', 'id': '8c07dc3b-d032-4343-a61e-d874a8fb99e8'} Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:41:25.363627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in _detach_volume Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 06:41:25.364674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.366055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5152, in detach_volume Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5132, in _detach_volume Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:41:25.367370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) Jul 29 06:41:25.369451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:41:25.370708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0bb41691-c3b2-4ce2-96cc-c7378c1ab5cb) {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:41:25.370708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-51ee70d9-b7ec-4c87-89d7-1fce3f226a0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8" status: 400 len: 269 microversion: 2.1 time: 0.235009 Jul 29 06:41:25.370708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 816/1664] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 06:41:25 2022] DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0/os-volume_attachments/8c07dc3b-d032-4343-a61e-d874a8fb99e8 => generated 269 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:41:26.273986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:26.275284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:26.281936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:26.282388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:26.283152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:26.283591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:26.411503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:26.419657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d4287e2c-a23c-4cb0-b235-8a8fd67a8e12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149533 Jul 29 06:41:26.420240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 849/1665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:27.441130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:27.441763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:27.448420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:27.448903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:27.449673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:27.450128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:27.581111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:27.589376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ee730b5b-6466-41a0-9c97-ac08de7824af tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152694 Jul 29 06:41:27.589955 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 817/1666] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:28.610442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:28.611079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:28.617497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:28.618520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:28.619330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:28.619767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:28.902087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:28.909587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c824f1bf-d81e-4ba0-ae1a-14be5c83a29c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.303341 Jul 29 06:41:28.910142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 850/1667] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:29.932309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:29.932971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:29.939495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:29.939891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:29.940673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:29.941111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:30.141173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:30.148772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1fbf93b7-00b3-4596-89e4-412525edeb33 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.221463 Jul 29 06:41:30.149820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 818/1668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:31.170364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:31.171012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:31.177715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:31.178169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:31.178931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:31.179844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:31.308642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:31.316396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ec70796-b40c-4671-8d31-c268cbec0b8b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149914 Jul 29 06:41:31.317291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 851/1669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:32.338909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:32.339525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:32.346108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:32.346562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:32.347331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:32.347770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:32.479758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:32.487186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7ea43d3a-f88b-4751-a128-62ea0b2f5fec tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152592 Jul 29 06:41:32.487746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 819/1670] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:33.508695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:33.509340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:33.515812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:33.516263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:33.517062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:33.517502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:33.643207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:33.650761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ae9b14b-7058-4331-b8d0-71d0d78bc827 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.145978 Jul 29 06:41:33.651314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 852/1671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:34.671988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:34.672634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:34.679102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:34.679551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:34.681052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:34.681503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:34.813417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:34.821441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2abc2264-372c-4f2e-aa61-c80ba8ee7066 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152758 Jul 29 06:41:34.822348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 820/1672] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:35.843046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:35.843659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:35.850169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:35.850619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:35.851381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:35.851818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:35.984781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:35.992260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d63ad9f-fca8-49de-831f-f89d59adde3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153090 Jul 29 06:41:35.993387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 853/1673] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:37.014371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:37.014915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:37.021349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:37.021801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:37.022563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:37.022996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:37.149880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:37.158086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a3a165a8-d0fb-4890-ba2b-949f5fa7fe4c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.147645 Jul 29 06:41:37.158658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 821/1674] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:38.180618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:38.181243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:38.188750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:38.189197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:38.189962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:38.190396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:38.320983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:38.328336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e0091232-b20f-49d5-9289-37f146aa4408 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152063 Jul 29 06:41:38.328928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 854/1675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:39.350063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:39.350677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:39.357365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:39.357812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:39.358566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:39.358995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:39.486084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:39.494024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-872bb0d5-785a-434b-a878-698df03cb252 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.147814 Jul 29 06:41:39.494585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 822/1676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:41:40.514553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:40.515167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:40.521608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:40.522055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:40.522815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:40.523243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:40.636036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:41:40.636615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:41:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:41:40.656203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:40.663570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6cbe3218-5032-4587-b087-79a254f158fd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152934 Jul 29 06:41:40.664138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 855/1677] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:41.685054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:41.685692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:41.692277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:41.692653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:41.693417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:41.693849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:41.829348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:41.837080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0067d4ae-d6ab-4db2-90b4-d502defca2ac tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.155922 Jul 29 06:41:41.838333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 823/1678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:42.858722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:42.859336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:42.866174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:42.866620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:42.867381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:42.867817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:42.995585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:43.003023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87df8419-60db-4d25-91d6-243539ae953b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148045 Jul 29 06:41:43.003607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 856/1679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:44.024232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:44.024948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:44.031607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:44.032063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:44.032854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:44.033290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:44.161742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:44.169762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0c9f958d-1f34-4edd-8a60-d3f0251dff12 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149469 Jul 29 06:41:44.170354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 824/1680] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:45.190547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:45.191169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:45.198428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:45.198883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:45.199650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:45.200092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:45.334101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:45.342057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-588e0699-c615-4920-96a7-74228da8f4b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.155405 Jul 29 06:41:45.342622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 857/1681] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:46.363918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:46.364518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:46.371353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:46.371804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:46.372592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:46.373038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:46.504483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:46.512680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-89f7bd88-13b2-4f6a-9c2c-83b8297c6320 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152668 Jul 29 06:41:46.513240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 825/1682] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:47.534049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:47.534623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:47.542017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:47.542465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:47.543255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:47.543685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:47.775706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:47.783318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eb93ba0d-add7-480f-a1ee-d122f0960760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.253258 Jul 29 06:41:47.783886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 858/1683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:48.804127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:48.804778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:48.811574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:48.812029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:48.812830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:48.813273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:48.954022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:48.961797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4fa8738e-8b69-4fc3-8c2f-29162e7f96a2 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.161525 Jul 29 06:41:48.962436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 826/1684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:49.982923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:49.983458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:49.990019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:49.990477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:49.991247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:49.991699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:50.121910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:50.129388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ca7f7a2-86bb-4ebd-8914-a6b188a5b572 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150456 Jul 29 06:41:50.129945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 859/1685] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:51.151474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:51.152083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:51.158703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:51.159148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:51.159900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:51.160335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:51.296446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:51.303828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c54d6eb7-5988-4d8f-b3c5-2734a4af9dcb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.156966 Jul 29 06:41:51.304385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 827/1686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:52.325216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:52.325821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:52.331748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:52.332197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:52.332978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:52.333408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:52.336155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=73 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:41:52.465499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:52.472970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-90bc26fe-7637-4052-af4f-f0bcda676cb6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151805 Jul 29 06:41:52.473535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 860/1687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:52.832757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:41:52.833215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:41:53.495108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:53.495714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:53.502249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:53.502736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:53.503470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:53.503899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:53.506396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=75 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:41:53.637515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:53.645058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-731d0df5-4565-46cd-9585-edb82a5a338a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153815 Jul 29 06:41:53.645622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 828/1688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:54.667539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:54.668158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:54.674894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:54.675344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:54.676111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:54.676562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:54.806655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:54.813916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-469967ff-d17d-497f-ad88-545fdbb376ba tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150972 Jul 29 06:41:54.814477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 861/1689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:55.835217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:55.836126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:55.839150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=27 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:41:55.845121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:55.845570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:55.846326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:55.846756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:55.975197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:55.983188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ed1ad54e-279f-44f9-9b08-f07c6d94bec3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151878 Jul 29 06:41:55.983744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 829/1690] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:57.004604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:57.005125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:57.007408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=29 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:41:57.013825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:57.014278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:57.015046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:57.015538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:57.149136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:57.157233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fa901cdb-5a4d-4bb4-9688-4a77c3054f60 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.156654 Jul 29 06:41:57.157797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 862/1691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:58.178761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:58.179378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:58.185998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:58.186454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:58.187216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:58.187657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:58.318302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:58.326243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6bae13f3-babf-4070-ab46-d0b63c6b7804 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151426 Jul 29 06:41:58.326800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 830/1692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:59.348811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:41:59.349422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:41:59.355905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:59.356354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:59.357142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:41:59.357575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:41:59.486449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:41:59.493914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9f2fdfd5-c304-41d1-a8e1-bf789a415405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149045 Jul 29 06:41:59.494480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 863/1693] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:41:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:41:59.589080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:41:59.589638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:41:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:42:00.515388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:00.516001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:00.522471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:00.522917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:00.523665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:00.524097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:00.652806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:00.660224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7a764f0a-a02d-48ee-b445-565324091336 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148741 Jul 29 06:42:00.660818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 831/1694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:01.682340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:01.682955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:01.689474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:01.689924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:01.690687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:01.691135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:01.825311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:01.832793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7068601c-62e8-4970-a359-538bf7cb68d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.154916 Jul 29 06:42:01.833357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 864/1695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:02.855196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:02.855833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:02.862410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:02.862864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:02.863628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:02.864061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:02.996631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:03.004045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3073782d-6de2-4ad6-8c70-88494dbc7f7b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153009 Jul 29 06:42:03.004618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 832/1696] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:04.025544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:04.026086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:04.032662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:04.033123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:04.033895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:04.034345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:04.163422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:04.171044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8a87b97-36c5-4094-b142-d3649af28ccc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149571 Jul 29 06:42:04.171614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 865/1697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:05.192128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:05.192768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:05.199728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:05.200178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:05.200957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:05.201393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:05.330769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:05.338928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-687b11b9-b287-456d-9250-cb0d730c2c3c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150653 Jul 29 06:42:05.339511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 833/1698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:06.359855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:06.360463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:06.367069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:06.367520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:06.368830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:06.369274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:06.499172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:06.506741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a92de627-72bc-4709-a2f6-6700306d318a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150807 Jul 29 06:42:06.507310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 866/1699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:07.528459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:07.529133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:07.535833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:07.536229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:07.537029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:07.537470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:07.666764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:07.674245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a127aa27-d8f1-4c9e-b673-5c94252c1ef1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150379 Jul 29 06:42:07.674805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 834/1700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:08.694666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:08.695273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:08.701596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:08.701987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:08.702767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:08.703198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:08.836806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:08.844812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-196a8047-63f2-4144-b51a-1230b30508d3 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153998 Jul 29 06:42:08.845366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 867/1701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:09.866554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:09.867166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:09.874222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:09.874672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:09.875432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:09.875871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:10.011309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:10.018666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5f8235fd-6f93-4b24-805d-cf4293d1f722 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.155977 Jul 29 06:42:10.019215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 835/1702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:11.039874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:11.040510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:11.047171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:11.047615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:11.048368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:11.048832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:11.178864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:11.186940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fedcb5b0-158a-4994-9a84-910afa1fae2a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.150948 Jul 29 06:42:11.187500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 868/1703] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:12.207169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:12.207773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:12.215334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:12.215778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:12.216530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:12.216986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:12.343845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:12.351333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-50e9ba57-9c6e-43b3-8586-794c67d1a72c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148031 Jul 29 06:42:12.351896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 836/1704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:13.371305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:13.371894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:13.378586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:13.379029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:13.379783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:13.380211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:13.512847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:13.520235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e5770b8c-be2f-4a56-88aa-af924e6935cb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152860 Jul 29 06:42:13.520820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 869/1705] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:14.543782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:14.544424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:14.551148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:14.551629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:14.552398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:14.553013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:14.683840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:14.691190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-51788ca3-1efe-4831-9a14-0a681b02d3fc tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152328 Jul 29 06:42:14.691736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 837/1706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:15.711279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:15.711882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:15.718464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:15.718925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:15.719705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:15.720141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:15.847151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:15.855210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca979736-6a22-4120-be28-88344e0cb76a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148033 Jul 29 06:42:15.855770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 870/1707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:16.875937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:16.876591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:16.883094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:16.883543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:16.884421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:16.884892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:17.017298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:17.027521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-65041cbb-a6ff-4610-915a-7c253155cd11 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.155382 Jul 29 06:42:17.028102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 838/1708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:18.051048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:18.051600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:18.058205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:18.058651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:18.059400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:18.059835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:18.190432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:18.198357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7d5a2c9f-99b2-46f4-8e5d-fa2cdadabfe6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.151244 Jul 29 06:42:18.198915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 871/1709] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:19.219319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:19.219984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:19.226556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:19.227012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:19.228398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:19.228881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:19.357935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:19.365370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9411a265-a49b-4181-9420-6a30880adc03 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149893 Jul 29 06:42:19.365935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 839/1710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:20.387102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:20.387712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:20.394625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:20.395067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:20.395823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:20.396258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:20.523597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:20.531551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-775f8cac-c4a1-4425-a421-7cb36d3d41e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.148561 Jul 29 06:42:20.532106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 872/1711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:21.552468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:21.553228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:21.560367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:21.560833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:21.561587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:21.562016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:21.694201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:21.702033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-527c5c71-2b96-4173-af9b-66c6d63428d1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153404 Jul 29 06:42:21.702598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 840/1712] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:22.722933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:22.723462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:22.730446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:22.730904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:22.731695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:22.732125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:22.734799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=78 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:22.860884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:22.868319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0df49066-fe35-408f-8c2e-8127fb7b9528 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.149511 Jul 29 06:42:22.869208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 873/1713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:23.890205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:23.890820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:23.896867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:23.897323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:23.898075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:23.898511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:23.901062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=78 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:24.025820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:24.033304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-37850757-1f21-4764-a97c-ed16611f02c1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.147113 Jul 29 06:42:24.033870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 841/1714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:25.054846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:25.055461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:25.062249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:25.062699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:25.063469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:25.063904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:25.195701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:25.203125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2c47b5d-db68-4c9f-a8ae-f0a12b6b6997 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.152255 Jul 29 06:42:25.203678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 874/1715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:25 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:26.224029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:26.224663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:26.226956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=26 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:26.233028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:26.233477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:26.234265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:26.234727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:26.368243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:26.376371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6f33c994-7af8-4df2-996a-a9f9737a5d92 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.156183 Jul 29 06:42:26.377040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 842/1716] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:27.397292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:27.397908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:27.400970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=26 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:27.406526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:27.406977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:27.407744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:27.408186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:27.542708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:27.550170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-485e763b-c0a3-47f2-a246-4dbe725d91b9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.156700 Jul 29 06:42:27.550731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 875/1717] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:28.571378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:28.571999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:28.578434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:28.578889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:28.579657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:28.580092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:28.705834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:28.713601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e663188a-af88-4df7-bec2-9ef04ac78618 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.146058 Jul 29 06:42:28.714165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 843/1718] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:29.734351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:29.734970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:29.741706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:29.742166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:29.742937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:29.743928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:29.876232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:29.883764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d3c96188-67b2-4eae-bb4f-cdb08e0d8ac6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.153291 Jul 29 06:42:29.885358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 876/1719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:30.906396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:30.907013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:30.913795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:30.914253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:30.915013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:30.916215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:31.055518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:31.063814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8766c8a4-0f90-4100-beed-0495d4336538 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.161390 Jul 29 06:42:31.064380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 844/1720] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:32.088902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:32.088902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:32.095410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:32.095873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:32.096770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:32.097117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:32.233554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:32.241189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f9a3364e-b3cd-467e-a0cc-f70f52adca62 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1451 microversion: 2.1 time: 0.159601 Jul 29 06:42:32.241761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 877/1721] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:32.800424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-39ea182c-9554-4b44-ba90-b1e4a3393735 req-f90c4159-daf8-462c-a3eb-fec37af99cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0edc82ad-0d5b-4b12-b5fa-e69548ffd732", "name": "network-vif-deleted", "tag": "7771fb54-6e8f-4267-8251-b0e5ae9ed6bb"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:42:32.820186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-39ea182c-9554-4b44-ba90-b1e4a3393735 req-f90c4159-daf8-462c-a3eb-fec37af99cf6 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:32.829898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-39ea182c-9554-4b44-ba90-b1e4a3393735 req-f90c4159-daf8-462c-a3eb-fec37af99cf6 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:32.849405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-39ea182c-9554-4b44-ba90-b1e4a3393735 req-f90c4159-daf8-462c-a3eb-fec37af99cf6 service nova] Creating event network-vif-deleted:7771fb54-6e8f-4267-8251-b0e5ae9ed6bb for instance 0edc82ad-0d5b-4b12-b5fa-e69548ffd732 on hv-cinder-83482 Jul 29 06:42:32.856981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-39ea182c-9554-4b44-ba90-b1e4a3393735 req-f90c4159-daf8-462c-a3eb-fec37af99cf6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060124 Jul 29 06:42:32.857770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 845/1722] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:42:33.262792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:33.263344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:33.269881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:33.270349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:33.271114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:33.271547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:33.332429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:33.340237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8a65e0a9-f0ea-4d3b-ab8b-468b18a7cd35 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082079 Jul 29 06:42:33.340819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 878/1723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:34.361730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:34.362418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:34.369127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:34.369584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:34.370341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:34.370772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:34.432325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:34.439906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7ebb1390-49b7-45e5-b72a-d4a6fe11b484 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082742 Jul 29 06:42:34.440474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 846/1724] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:35.461425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:35.462755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:35.469552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:35.470007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:35.470783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:35.471226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:35.532161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:35.540127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-52f93a1d-f1d8-41ed-ba9e-40d08da20152 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082783 Jul 29 06:42:35.541054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 879/1725] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:35 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:36.561381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:36.561990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:36.568389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:36.568870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:36.569621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:36.570054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:36.630240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:36.638075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c407ed3e-53c4-4474-b69c-31caf4b24f40 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080576 Jul 29 06:42:36.638628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 847/1726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:37.658330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:37.658950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:37.666011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:37.666458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:37.667225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:37.667664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:37.728993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:37.736436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-00492a09-63dc-47c7-a1c5-9b3750d0d07a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081971 Jul 29 06:42:37.737035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 880/1727] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:38.757770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:38.758398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:38.765806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:38.766259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:38.767028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:38.767467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:38.827989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:38.835451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-816427c2-1f1d-4d8a-9f95-25c615a38dc1 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081682 Jul 29 06:42:38.836284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 848/1728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:42:39.856745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:39.857366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:39.864001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:39.864454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:39.865268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:39.865706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:39.928732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:39.936868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7d6ea304-d6ba-4b4a-9d77-67627a9f9b2d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084504 Jul 29 06:42:39.937425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 881/1729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:40.958079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:40.958739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:40.966060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:40.966504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:40.967254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:40.967694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:41.032377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:41.039741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-32392854-f664-416e-a5bf-a6a9ec1af62a tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085491 Jul 29 06:42:41.041065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 849/1730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:42.061542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:42.062060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:42.068479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:42.068956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:42.069715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:42.070149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:42.131734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:42.139266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8f1c9bdd-44eb-4269-b3b8-284ef29ae48f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081707 Jul 29 06:42:42.139835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 882/1731] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:43.159195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:43.159812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:43.167242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:43.167698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:43.168464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:43.168931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:43.229709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:43.237120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5f1d7747-4180-4f8d-b70b-269ae5e9551b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081808 Jul 29 06:42:43.237678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 850/1732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:44.257435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:44.258053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:44.265580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:44.266025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:44.266781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:44.267211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:44.327290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:44.334669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a051dc7d-f34c-47f6-8f6d-7b9780ed8e23 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081109 Jul 29 06:42:44.335229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 883/1733] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:45.356855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:45.357470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:45.363972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:45.364418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:45.365209 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:45.365641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:45.425338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:45.433374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bacfb1e2-6727-4fcf-8948-f1b2d9f2d487 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080606 Jul 29 06:42:45.433921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 851/1734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:46.454840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:46.455460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:46.462351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:46.462804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:46.465372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:46.465372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:46.528268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:46.535798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e1ba24a6-bb2b-45bd-b773-429647ad1450 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084899 Jul 29 06:42:46.536354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 884/1735] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:46 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:47.557931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:47.558530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:47.565039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:47.565490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:47.566254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:47.566692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:47.628331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:47.636667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6d6268e7-bea9-491b-865b-1842554e5b61 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083701 Jul 29 06:42:47.637218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 852/1736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:48.657046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:48.657658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:48.664090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:48.664553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:48.665879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:48.666314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:48.730036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:48.737756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c1305435-617d-4e71-b982-0f3e9ec6745d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084535 Jul 29 06:42:48.738327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 885/1737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:49.758180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:49.758863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:49.765368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:49.765822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:49.766589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:49.767021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:49.829837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:49.838263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5fedac81-041e-49f2-ad69-5f82a14dc552 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083984 Jul 29 06:42:49.838820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 853/1738] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:50.859856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:50.860474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:50.866658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:50.867116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:50.867936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:50.868399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:50.928703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:50.936479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3db0f703-a375-4fc1-b87d-4b936d61b9d7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080913 Jul 29 06:42:50.937341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 886/1739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:51.958082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:51.958733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:51.966174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:51.966632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:51.967396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:51.967839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:52.029587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:52.036957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e269414a-a2f6-46cf-9721-a7e58dbf835c tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082755 Jul 29 06:42:52.037521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 854/1740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:53.058104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:53.058660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:53.065433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:53.065919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:53.066689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:53.067404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:53.069991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:53.129483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:53.137561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05c2817a-f761-4621-9f49-7ee39c5dbc69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084045 Jul 29 06:42:53.138126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 887/1741] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:54.159023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:54.159644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:54.166341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:54.166794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:54.167563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:54.168000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:54.170759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=80 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:54.229782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:54.237229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a48cdd05-11a7-4183-82d6-3d924309f4d8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082128 Jul 29 06:42:54.237794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 855/1742] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:55.257856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:55.258569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:55.265313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:55.265767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:55.266535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:55.266977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:55.329294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:55.337892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3e2dba57-cea8-4cf6-a3f2-0c945c8ee7d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083811 Jul 29 06:42:55.338464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 888/1743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:55 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:56.358907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:56.359509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:56.361902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=28 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:56.367313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:56.368372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:56.369164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:56.369593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:56.431097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:56.438566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3352e584-e630-400a-a75f-c8c23bb99ceb tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083567 Jul 29 06:42:56.439126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 856/1744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:57.459272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:57.459899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:57.463157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=28 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:42:57.468557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:57.469042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:57.469803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:57.470235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:57.540361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:57.548185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c1404bf4-a2eb-4faf-9038-7de8ad4504c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.092772 Jul 29 06:42:57.548783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 889/1745] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:58.568497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:58.569146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:58.576136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:58.576616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:58.577373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:58.577802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:58.641192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:58.648576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ed5ce14e-50db-44cd-aeb2-37d0e60b9c81 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083915 Jul 29 06:42:58.649760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 857/1746] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:42:59.669659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:42:59.670272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:42:59.676785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:59.677239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:59.677995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:42:59.678431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:42:59.740771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:42:59.748698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a8b49866-0043-4fbf-b083-bebc69d8f229 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083856 Jul 29 06:42:59.749266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 890/1747] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:42:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:00.769171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:00.769794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:00.777386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:00.777845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:00.778613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:00.779058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:00.839769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:00.847242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-86707a89-68d8-4edf-9110-a6d95cc10bc0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081920 Jul 29 06:43:00.847804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 858/1748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:01.868853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:01.869455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:01.875948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:01.876397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:01.877184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:01.877614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:01.937558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:01.944935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-02f6f974-c1ca-4d6b-8f06-1ad41ad665ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080714 Jul 29 06:43:01.945486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 891/1749] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:02.966105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:02.966716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:02.973220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:02.973667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:02.974416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:02.974844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:03.034937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:03.043149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-099778d0-d1b3-43c1-97df-13705a9504b8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080925 Jul 29 06:43:03.043710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 859/1750] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:04.064613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:04.065152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:04.072414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:04.072889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:04.073654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:04.074091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:04.134199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:04.141648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e27ca4cb-bd6a-4f3f-ae9c-f8460dc9ce38 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081047 Jul 29 06:43:04.142208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 892/1751] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:05.161290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:05.161933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:05.169094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:05.169537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:05.170289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:05.170717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:05.230617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:05.238021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5dfa9ec1-c7f9-4e66-bda5-6e40ec13a760 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080593 Jul 29 06:43:05.238604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 860/1752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:06.259261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:06.259837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:06.266379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:06.266829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:06.267583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:06.268015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:06.332798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:06.340473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f724238-ae8a-4c62-96e1-2f3959765ae5 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085652 Jul 29 06:43:06.341052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 893/1753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:06 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:07.360296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:07.360947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:07.367489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:07.367950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:07.368768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:07.369210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:07.432634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:07.440152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0274d116-3b7f-4161-883c-32acbdda2684 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083717 Jul 29 06:43:07.440742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 861/1754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:08.462402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:08.463296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:08.469713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:08.470166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:08.470920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:08.471353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:08.534291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:08.542499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d152a133-b443-4e3b-b2eb-3d2fa89e3e48 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084294 Jul 29 06:43:08.543069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 894/1755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:09.562433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:09.563053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:09.569648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:09.570107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:09.570871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:09.571966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:09.635556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:09.642993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-07b5045b-abb1-43b6-a722-fec5d066fc95 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084403 Jul 29 06:43:09.643561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 862/1756] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:10.664161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:10.664843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:10.672334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:10.672816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:10.673580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:10.674018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:10.738230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:10.746783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-17cc70f3-605d-415c-a377-f6bcf886fd69 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.086487 Jul 29 06:43:10.747346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 895/1757] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:11.767149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:11.767752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:11.774148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:11.775098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:11.775842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:11.776272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:11.835272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:11.843433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0a8c2360-63a8-4855-9596-ba3824518bcd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080124 Jul 29 06:43:11.843985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 863/1758] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:12.865073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:12.865621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:12.872377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:12.872913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:12.873676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:12.874114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:12.934319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:12.941922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3cf3d8af-5290-460b-b87a-cc1db195f1bf tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080781 Jul 29 06:43:12.942500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 896/1759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:13.963711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:13.964318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:13.970778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:13.971224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:13.971980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:13.972410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:14.032428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:14.039880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9daeb73-9f57-46dd-a64f-c10db41d0cae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080789 Jul 29 06:43:14.041137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 864/1760] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:14.440132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:43:14.440748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:43:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:43:15.061331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:15.061873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:15.068437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:15.068928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:15.069699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:15.070142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:15.133116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:15.141287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e25a50d7-c21f-4f53-a2e3-7ad58f6812f8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083898 Jul 29 06:43:15.141847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 897/1761] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:16.162638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:16.163261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:16.170652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:16.171101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:16.171855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:16.172298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:16.235108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:16.242392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c990b32-7749-4736-b626-eeed906b8f64 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083653 Jul 29 06:43:16.243001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 865/1762] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:17.263544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:17.264147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:17.270776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:17.271227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:17.272010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:17.272439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:17.341445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:17.349039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8f5a4151-9533-4b87-b87d-26ecef104430 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.089383 Jul 29 06:43:17.349614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 898/1763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:17 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:18.379191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:18.379809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:18.386939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:18.387395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:18.388162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:18.388647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:18.451487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:18.464814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe1a587c-83ab-4b57-ac30-3a048a57d108 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.088902 Jul 29 06:43:18.465451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 866/1764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:19.485809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:19.486416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:19.492859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:19.493304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:19.494055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:19.495253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:19.556407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:19.563876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d83a022-8f4e-4fe3-b8b5-3d83b084ca3d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081929 Jul 29 06:43:19.564430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 899/1765] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:20.584893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:20.585483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:20.592893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:20.593345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:20.594097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:20.594528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:20.654947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:20.662320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6dd31e9a-6573-44ef-9f23-43795bb851a8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081256 Jul 29 06:43:20.662873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 867/1766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:21.683671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:21.684222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:21.690386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:21.690828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:21.691584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:21.692017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:21.753973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:21.761948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1580d1b-7783-4695-80b5-9c0a638b606f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082650 Jul 29 06:43:21.762507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 900/1767] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:21 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:22.782246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:22.782857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:22.789362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:22.789810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:22.790563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:22.791023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:22.853113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:22.861089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b29e9a93-7d7d-4ad2-aac3-1bfed5c38bf0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082747 Jul 29 06:43:22.861658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 868/1768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:22 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:23.881467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:23.882075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:23.889073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:23.889523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:23.890298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:23.890733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:23.894726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:23.954849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:23.962574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-41624184-070d-4652-9556-9a9d05e10405 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084961 Jul 29 06:43:23.963139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 901/1769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:23 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:24.983095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:24.983630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:24.989832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:24.990281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:24.991037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:24.991475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:24.996007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:25.055975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:25.064135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-00c6b89d-aa29-4f8d-b223-d24e0699b7c9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085130 Jul 29 06:43:25.064730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 869/1770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:24 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:25.679516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:25.679991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:25.687023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:25.687468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:25.688230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:25.688738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:25.716013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:43:25.796181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a9bc03f2-7c3b-4a79-a21f-b58bf67d8689 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 204 len: 0 microversion: 2.20 time: 0.119946 Jul 29 06:43:25.796707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 902/1771] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Jul 29 06:43:25 2022] DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 06:43:25.804961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:25.805892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:25.811925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:25.812371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:25.813193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:25.813631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:25.945635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:25.954252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:25.955794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:25.957027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b3fbf1b0-d5dd-4542-9001-6a581d3e1ed8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1801 microversion: 2.20 time: 0.156009 Jul 29 06:43:25.957585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 870/1772] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1801 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:26.085724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:26.086730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:26.093452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:26.093909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:26.094688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:26.095127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:26.158082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:26.165566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e0c9527-691e-4193-85f4-8124f5ba6305 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084031 Jul 29 06:43:26.166153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 903/1773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:26 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:26.981679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:26.982293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:26.984672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=30 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:26.990454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:26.990915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:26.991682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:26.992118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:27.054566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:27.063135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:27.064659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:27.065853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-23e0db7e-647e-4dac-80ad-4e8f654700ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1733 microversion: 2.20 time: 0.088136 Jul 29 06:43:27.066412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 871/1774] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1733 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:27.186643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:27.187352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:27.193809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:27.194269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:27.195051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:27.195493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:27.232266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-58fcb2ca-a81b-43e5-8236-728ffd9a5676 req-8d7b928f-cc23-49d6-8782-f565ddfe0c3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e189d03-298a-49f1-8edc-ee412247810f", "name": "network-vif-deleted", "tag": "fe4f967a-50a7-4ffa-99ce-131814a41469"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:43:27.267018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-58fcb2ca-a81b-43e5-8236-728ffd9a5676 req-8d7b928f-cc23-49d6-8782-f565ddfe0c3c service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:27.267474 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-58fcb2ca-a81b-43e5-8236-728ffd9a5676 req-8d7b928f-cc23-49d6-8782-f565ddfe0c3c service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:27.283356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-58fcb2ca-a81b-43e5-8236-728ffd9a5676 req-8d7b928f-cc23-49d6-8782-f565ddfe0c3c service nova] Creating event network-vif-deleted:fe4f967a-50a7-4ffa-99ce-131814a41469 for instance 6e189d03-298a-49f1-8edc-ee412247810f on hv-cinder-83482 Jul 29 06:43:27.290818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-58fcb2ca-a81b-43e5-8236-728ffd9a5676 req-8d7b928f-cc23-49d6-8782-f565ddfe0c3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151455 Jul 29 06:43:27.291753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 904/1775] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:43:27.294038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:27.302161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-31841277-93f0-41ab-beb4-9c687a8b0473 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.119537 Jul 29 06:43:27.302925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 872/1776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:27 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:28.090732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:28.091454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:28.093443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:28.099421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:28.100001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:28.100804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:28.101390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:28.169132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:28.178515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:28.180227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:28.181446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cf36401e-cfbf-46c3-97a7-3e47c5ed2c86 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.095503 Jul 29 06:43:28.182598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 905/1777] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:28.323344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:28.323883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:28.330389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:28.330834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:28.331592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:28.332027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:28.395216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:28.403222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e0c3cd84-c876-45e3-9325-71f779bda42e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083801 Jul 29 06:43:28.403783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 873/1778] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:28 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:29.206892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:29.207501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:29.214258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:29.214705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:29.215468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:29.215900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:29.276606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:29.284891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:29.286367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:29.287523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-48dcfcbf-5cc1-4b80-9be3-1df7c8a66238 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084585 Jul 29 06:43:29.288096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 906/1779] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:29.423153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:29.423764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:29.430303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:29.430747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:29.431525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:29.432873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:29.493269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:29.500866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ab253df5-d8b3-4841-92aa-5b43a47d8692 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081637 Jul 29 06:43:29.501436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 874/1780] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:29 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:30.311051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:30.311659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:30.318154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:30.318594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:30.319349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:30.319782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:30.380136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:30.388563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:30.390064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:30.391207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87dd6054-56ed-4d4d-97ef-ec7c1ae041d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084383 Jul 29 06:43:30.391737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 907/1781] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:30.521807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:30.522422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:30.529081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:30.529531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:30.530291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:30.530731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:30.591900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:30.599340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c2d37dd3-b1df-4800-a30e-ad4f27ad777d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081368 Jul 29 06:43:30.599915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 875/1782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:30 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:31.414351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:31.414954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:31.421925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:31.422379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:31.423144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:31.423581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:31.487405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:31.495811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:31.497329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:31.498454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-818496b4-cdf5-430d-b418-3732fdaf5437 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088011 Jul 29 06:43:31.499003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 908/1783] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:31.620072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:31.620732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:31.627122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:31.627566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:31.628317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:31.628775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:31.691405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:31.699419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-11d07372-13cd-492a-9103-d97345aa3a94 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083211 Jul 29 06:43:31.699974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 876/1784] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:31 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:32.521380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:32.521994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:32.529489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:32.529951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:32.530760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:32.531204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:32.719831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:32.720365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:32.726887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:32.727344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:32.728116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:32.729220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:32.746120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:32.754470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:32.755996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:32.757158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ea3d16c8-5cf4-4389-8a3e-6fac3468aaeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.239679 Jul 29 06:43:32.757712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 909/1785] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:32.793347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:32.800816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-015ca77d-6fe8-4d47-83ec-11d20bd0cc27 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084908 Jul 29 06:43:32.801398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 877/1786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:32 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:33.779942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:33.780569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:33.787058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:33.787499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:33.788247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:33.788714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:33.821316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:33.821926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:33.829150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:33.829595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:33.830368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:33.830797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:33.850022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:33.859187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:33.860804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:33.861936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-df44c205-ca88-4d09-abd2-006b847d66ba tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086542 Jul 29 06:43:33.862487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 910/1787] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:33.893243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:33.900691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-662cf8fd-2251-434b-bc54-95e34116165d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083149 Jul 29 06:43:33.901253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 878/1788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:33 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:34.886439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:34.887049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:34.893649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:34.894098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:34.894851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:34.895284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:34.921583 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:34.922227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:34.928728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:34.929181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:34.929946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:34.930386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:34.955806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:34.965306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:34.966789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:34.967934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4ce9ad52-8a0b-4524-8464-fcc9520351b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085877 Jul 29 06:43:34.968489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 911/1789] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:34.997170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:35.004682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe49147e-4032-43d5-b99d-7ef110794446 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.086901 Jul 29 06:43:35.005242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 879/1790] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:34 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:35.991425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:35.991960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:35.999290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:35.999745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:36.000503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:36.000957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:36.024470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:36.025281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:36.031737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:36.032265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:36.033037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:36.033472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:36.061521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:36.069880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:36.071372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:36.072586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1a98a1a6-378d-41aa-818d-ca0f973f7b02 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085164 Jul 29 06:43:36.073144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 912/1791] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:36.095024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:36.102530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bda1dea0-cf55-479f-b6b8-69c03aba5028 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081920 Jul 29 06:43:36.103081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 880/1792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:36 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:37.095537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:37.096135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:37.102664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:37.103177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:37.104388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:37.104859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:37.123573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:37.124213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:37.130756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:37.131204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:37.132001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:37.132437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:37.169725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:37.178651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:37.180147 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:37.181864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5200355a-41d9-4e9b-95fb-e309a56a67f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089785 Jul 29 06:43:37.183194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 913/1793] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:37.196598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:37.205239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f02b2cba-dc3d-4c7f-b95c-84ded47915d9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085451 Jul 29 06:43:37.205796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 881/1794] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:37 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:38.206047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:38.206805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:38.214274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:38.214727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:38.215498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:38.215938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:38.225623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:38.226240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:38.233758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:38.234206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:38.234964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:38.235389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:38.277970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:38.286845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:38.288414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:38.289900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b40b10c5-ff26-4b61-9e84-065195372e35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087678 Jul 29 06:43:38.290457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 914/1795] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:38.298224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:38.305688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9012804f-c1f7-4433-8e87-327eeb059922 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083846 Jul 29 06:43:38.306316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 882/1796] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:38 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:39.312878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:39.313934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:39.320709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:39.321157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:39.321953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:39.322391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:39.325399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:39.326022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:39.332744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:39.333202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:39.333976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:39.334414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:39.387499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:39.395902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:39.397433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:39.398580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-79fcdab0-27cc-43c2-8570-aba0838f5edc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089672 Jul 29 06:43:39.399079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:39.399203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 915/1797] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:39.407319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f71bc24c-d06b-4e05-ad32-0778eef15801 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085725 Jul 29 06:43:39.407866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 883/1798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:39 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:40.422532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:40.423128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:40.428338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:40.428986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:40.429737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:40.430192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:40.430965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:40.431409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:40.435488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:40.435929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:40.436732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:40.437173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:40.493370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:40.495938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:40.498122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:40.503835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:40.505380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:40.505584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22cb9ccf-ee6b-46fe-a893-9b7f78645220 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081029 Jul 29 06:43:40.510219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 884/1799] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:40 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:43:40.510380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9ce66de4-c3db-480e-a4ce-323f1f2377a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088013 Jul 29 06:43:40.510380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 916/1800] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:41.529632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:41.530680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:41.530817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:41.531306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:41.538922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:41.539371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:41.540139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:41.542057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:41.542337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:41.542519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:41.543261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:41.543696 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:41.608200 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:41.610400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:41.615123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:41.617548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-48e09830-a0bd-41a6-8f17-0c503309ac28 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.094088 Jul 29 06:43:41.618132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 885/1801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:41 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:41.624332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:41.625877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:41.627003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b9ec190a-51ab-4899-84c0-86af0133b3b4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.100460 Jul 29 06:43:41.627542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 917/1802] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:42.639416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:42.640033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:42.646339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:42.646794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:42.647555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:42.647990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:42.649854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:42.651296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:42.657730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:42.658177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:42.658947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:42.659656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:42.710456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:42.718816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7acbe3fd-1862-4020-93a1-53986f2a4d08 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084210 Jul 29 06:43:42.722291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:42.725963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 886/1803] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:42 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:42.731904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:42.733995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:42.734631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-973239e2-3696-4758-ae59-68491783ef5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088621 Jul 29 06:43:42.735177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 918/1804] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:43.739156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:43.739768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:43.747416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:43.747864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:43.748658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:43.749094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:43.757323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:43.757962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:43.765155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:43.765601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:43.766365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:43.766799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:43.813026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:43.820411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e5b1954a-7025-4b1f-89ca-ceb536aad324 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085099 Jul 29 06:43:43.821000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 887/1805] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:43 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:43.829372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:43.839295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:43.840832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:43.841978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-97f4d5ec-fddd-4f8e-859e-8bc50e6331d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088472 Jul 29 06:43:43.842518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 919/1806] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:44.841434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:44.842064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:44.848568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:44.849025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:44.849778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:44.850238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:44.865528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:44.866282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:44.875655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:44.876112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:44.876939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:44.877377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:44.914886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:44.923476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ee8ee38e-0b17-4add-ad57-8ba58834b056 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085906 Jul 29 06:43:44.924049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 888/1807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:44 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:44.940078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:44.948591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:44.950088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:44.951274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8de24ef8-eb62-466b-be5d-42bd3afb87bc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089746 Jul 29 06:43:44.951818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 920/1808] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:45.944695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:45.945308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:45.952948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:45.953398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:45.954158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:45.954598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:45.973085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:45.973689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:45.980173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:45.980652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:45.981414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:45.981847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:46.022065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:46.029764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b2c37970-f6e6-43a0-8b37-9e096a8911ab tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.088950 Jul 29 06:43:46.030327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 889/1809] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:45 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:46.048864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:46.058021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:46.059504 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:46.060656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-beaed542-09f2-4688-a468-6135dfe20498 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091493 Jul 29 06:43:46.061196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 921/1810] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:47.050666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:47.051228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:47.058359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:47.058815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:47.059577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:47.060019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:47.084179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:47.084816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:47.092987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:47.093443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:47.094222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:47.094665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:47.123341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:47.131558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a45575ea-bad2-4e3a-8115-5f3b06fd3021 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084938 Jul 29 06:43:47.132210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 890/1811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:47 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:47.159866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:47.168975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:47.170459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:47.171590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6ad9c62c-2d35-4caf-82b9-1a899f4d7480 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.092312 Jul 29 06:43:47.172146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 922/1812] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:48.153098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:48.153714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:48.160210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:48.160712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:48.161477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:48.161917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:48.193747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:48.194370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:48.201520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:48.201985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:48.202768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:48.203209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:48.223616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:48.231323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5a94a61e-67cb-42ce-9ece-5ebc5e497cb9 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082896 Jul 29 06:43:48.231895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 891/1813] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:48 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:48.265315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:48.273643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:48.275655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:48.276995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ad83a9f-3f69-4bb9-b2b4-50038fd34b7d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087247 Jul 29 06:43:48.277557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 923/1814] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:49.252173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:49.252808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:49.260083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:49.260655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:49.261412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:49.261846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:49.299214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:49.299831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:49.306606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:49.307171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:49.307958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:49.308409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:49.322447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:49.330051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b3518668-ca95-4d7d-b4fc-ee31754aa1e4 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081696 Jul 29 06:43:49.330622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 892/1815] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:49 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:49.373480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:49.381787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:49.383288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:49.385083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ec445db9-094a-46d8-be8d-5d757bdcc72f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089639 Jul 29 06:43:49.385828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 924/1816] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:50.355928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:50.356553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:50.363052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:50.363496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:50.364255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:50.364711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:50.409107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:50.409728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:50.416838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:50.417295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:50.418076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:50.418521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:50.483078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:50.492057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:50.493751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:50.494976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fee5fbca-c956-464a-aa6f-91e91dedf29d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089800 Jul 29 06:43:50.495548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 925/1817] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:50.671685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:50.679211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-576da603-1b24-4226-9719-35d1c51e7fc7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.327746 Jul 29 06:43:50.679774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 893/1818] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:50 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:51.411316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:43:51.411806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:43:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:43:51.518807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:51.519421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:51.526795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:51.527250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:51.528011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:51.528449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:51.590152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:51.598855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:51.600356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:51.601545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f7d1d059-082c-47ce-a969-7c03306f5a20 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086619 Jul 29 06:43:51.602087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 926/1819] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:51.700809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:51.701356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:51.707892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:51.708344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:51.709168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:51.709609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:51.771162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:51.779807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-925d89a4-e6d3-4f6f-95df-5dfd29529d4e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083755 Jul 29 06:43:51.780367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 894/1820] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:51 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:52.624753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:52.625366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:52.631901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:52.632351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:52.633135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:52.633578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:52.693898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:52.702774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:52.704305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:52.705478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0da50d71-fb9e-439e-b139-58b57ea6dccc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084695 Jul 29 06:43:52.706027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 927/1821] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:52.801110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:52.801732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:52.808873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:52.809329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:52.810093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:52.810535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:52.873186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:52.881309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f0fd5ac8-6e42-4b6d-b04c-899e0b8f3a00 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084041 Jul 29 06:43:52.881870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 895/1822] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:52 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:53.729460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:53.730189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:53.736674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:53.737121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:53.737881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:53.738315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:53.803013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:53.812191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:53.813714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:53.814853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9597bd49-63ce-427a-b105-4d833fb6dfb1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089475 Jul 29 06:43:53.815403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 928/1823] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:53.902602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:53.903211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:53.909554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:53.910013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:53.910783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:53.911228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:53.974104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:53.982149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7380cccb-28dd-4033-bc68-22156381ff76 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083312 Jul 29 06:43:53.982647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 896/1824] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:53 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:54.838956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:54.839636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:54.846122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:54.846571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:54.847324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:54.847792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:54.908674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:54.917322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:54.918838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:54.919981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-906d07a7-7638-4b1f-9f7c-1c9068d724f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085807 Jul 29 06:43:54.920559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 929/1825] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:55.002910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:55.003459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:55.010604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:55.011057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:55.011822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:55.012264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:55.074190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:55.081732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d6f60bfc-c791-40bb-93e4-900fa930ef0b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082688 Jul 29 06:43:55.082300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 897/1826] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:54 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:55.942677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:55.943274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:55.949866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:55.950310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:55.951064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:55.951496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:56.012317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:56.021199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:56.022686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:56.023819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a49b2e4-1807-47a8-ab3f-b98d921786e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085076 Jul 29 06:43:56.024367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 930/1827] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:56.103301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:56.103935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:56.110397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:56.110841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:56.111591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:56.112025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:56.172564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:56.179895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ba02c202-ecac-4518-9128-cc2162f1da06 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080988 Jul 29 06:43:56.180462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 898/1828] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:56 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:57.047641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:57.048248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:57.054766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:57.055220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:57.056679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:57.057129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:57.118914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:57.127616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:57.129154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:57.130306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1128dbb9-9024-4429-ac5a-2f37d44e3c44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086730 Jul 29 06:43:57.130853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 931/1829] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:57.200559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:57.201228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:57.203577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=56 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:57.208969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:57.209424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:57.210184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:57.210622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:57.271311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:57.279978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7a642906-5ae3-4cf5-bc0b-f4e123210c43 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083417 Jul 29 06:43:57.280573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 899/1830] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:57 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:58.155090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:58.155703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:58.158018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=54 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:58.163475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:58.163933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:58.164734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:58.165834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:58.229988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:58.238355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:58.239866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:58.241045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-54c2876f-bfc5-4cb2-9839-f375e64032b2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089948 Jul 29 06:43:58.241596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 932/1831] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:43:58.301353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:58.301969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:58.308515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:58.308989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:58.309747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:58.310185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:58.369278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:58.376601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e18b69ea-2b4a-45e8-98d1-89541b3d9169 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.079075 Jul 29 06:43:58.377163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 900/1832] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:58 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:43:59.263538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:59.264149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:59.270669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:59.271116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:59.271874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:59.272310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:59.286830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:43:59.333837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:59.342721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:59.344228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:59.345389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d7f63552-367d-437e-895d-ff37d8ad88a3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085871 Jul 29 06:43:59.345938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 933/1833] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:43:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:43:59.396791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:43:59.397397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:43:59.403902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:59.404381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:59.405233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:43:59.405663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:43:59.469569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:43:59.476989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-523135da-8f79-4ab4-a95d-8189d854c061 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083952 Jul 29 06:43:59.478179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 901/1834] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:43:59 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:00.369148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:00.369728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:00.376070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:00.376565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:00.377329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:00.377764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:00.440064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:00.449105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:00.450678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:00.451818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-71603b40-023f-49ba-bd9a-a46b87d306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087223 Jul 29 06:44:00.452370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 934/1835] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:00.498688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:00.499362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:00.505888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:00.506345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:00.507113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:00.507554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:00.522577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:00.570492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:00.578592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-09502031-8f44-4f42-9795-e939d95346da tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083772 Jul 29 06:44:00.579160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 902/1836] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:00 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:01.474810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:01.475452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:01.482435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:01.482884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:01.483645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:01.484081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:01.544913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:01.553269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:01.554762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:01.556386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d5e0bcfd-2c4e-4662-9dcc-27d0733cb016 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084958 Jul 29 06:44:01.556988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 935/1837] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:01.598998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:01.599616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:01.606148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:01.606601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:01.607365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:01.607806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:01.667580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:01.674990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-751f05c7-bb0e-4a74-95c8-86b35f98c06f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.079787 Jul 29 06:44:01.675581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 903/1838] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:01 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:02.578536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:02.579153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:02.585760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:02.586215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:02.587770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:02.588207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:02.652957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:02.661339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:02.662852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:02.664004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e9d345ba-de9c-4f21-b930-6dc7e230213d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089424 Jul 29 06:44:02.664574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 936/1839] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:44:02.695742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:02.696353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:02.702824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:02.703275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:02.704037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:02.704473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:02.764936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:02.772241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-998dd372-839e-491c-86a5-c9e6cde9607d tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080338 Jul 29 06:44:02.772830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 904/1840] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:02 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:03.687365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:03.687960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:03.694447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:03.694898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:03.695658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:03.696656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:03.757680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:03.766533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:03.768024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:03.769190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-81013b5e-8a86-4f4c-be05-e765888b1ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085815 Jul 29 06:44:03.769742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 937/1841] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:03.793445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:03.794091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:03.800474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:03.800952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:03.801707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:03.802138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:03.866491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:03.874145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-de64f1b7-d79e-469c-9144-db32cc36d3a0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084608 Jul 29 06:44:03.874700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 905/1842] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:03 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:04.792557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:04.793172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:04.799664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:04.800112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:04.800896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:04.801331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:04.862149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:04.871042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:04.872528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:04.873686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-17e9bbff-ac5f-4934-9060-2915e2fdb7c7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085142 Jul 29 06:44:04.874233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 938/1843] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:04.895108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:04.895725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:04.902775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:04.903223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:04.903986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:04.904424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:04.964775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:04.972114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a6698181-8eca-400d-bd2f-66e42544a8ae tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080824 Jul 29 06:44:04.972695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 906/1844] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:04 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:05.896418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:05.897073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:05.903836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:05.904285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:05.905089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:05.905528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:05.967424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:05.975886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:05.977634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:05.978870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-89e3ef99-50ab-4e8d-9b19-f40f61774324 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086407 Jul 29 06:44:05.979421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 939/1845] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:05.993544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:05.994172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:06.000645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:06.001099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:06.001860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:06.002297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:06.062810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:06.070138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ae9d2741-a9c7-4eb7-a197-99ee292bbe04 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080576 Jul 29 06:44:06.070706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 907/1846] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:05 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:07.002386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:07.002995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:07.010068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:07.010512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:07.011269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:07.011705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:07.074301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:07.082525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:07.084045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:07.085219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1179d0f-dfbe-4330-b69c-2624433d9544 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086736 Jul 29 06:44:07.085762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 940/1847] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:07.091511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:07.092129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:07.098839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:07.099291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:07.100308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:07.100785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:07.164391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:07.173134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eb18ecf0-6a2c-4f53-b1c5-20492f5286b0 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.085575 Jul 29 06:44:07.173692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 908/1848] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:07 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:08.109427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:08.110031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:08.116528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:08.117010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:08.117763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:08.118271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:08.194172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:08.194848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:08.202650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:08.203101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:08.203870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:08.204305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:08.270195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:08.279016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-63caec04-2dfd-4cac-861a-48b8cbcee1c7 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.088630 Jul 29 06:44:08.279833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 909/1849] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:08 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:44:08.389641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:08.398052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:08.400076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:08.401249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-adb052d5-2964-4931-839b-6fd5eb5e894b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.295804 Jul 29 06:44:08.401808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 941/1850] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:09.299626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:09.300239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:09.306767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:09.307213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:09.307967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:09.308402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:09.369223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:09.376721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-212e381f-1fc3-400f-800d-c3c84f426631 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080873 Jul 29 06:44:09.377280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 910/1851] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:09 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:09.424008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:09.424699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:09.431221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:09.431665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:09.432422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:09.432884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:09.493540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:09.501778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:09.503268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:09.504404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-537afbea-a3eb-4de0-a470-31acd675a106 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084528 Jul 29 06:44:09.504982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 942/1852] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:10.397525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:10.398140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:10.405158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:10.405606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:10.406359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:10.406792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:10.466683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:10.474014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5718ee30-c0a5-497e-81dd-f9ad1698ddc8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080349 Jul 29 06:44:10.474568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 911/1853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:10 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:10.527395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:10.528003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:10.534500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:10.534954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:10.535717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:10.536155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:10.597115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:10.605488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:10.606985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:10.608124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2919dfb4-aab2-48a5-9489-7e9d214e5388 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084723 Jul 29 06:44:10.608701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 943/1854] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:11.494496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:11.495115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:11.501609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:11.502062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:11.502832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:11.503274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:11.563341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:11.571352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-971b183c-c07e-4b67-a87e-1791f1ee4457 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080236 Jul 29 06:44:11.572087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 912/1855] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:11 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:11.631674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:11.632284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:11.639760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:11.640215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:11.641017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:11.641464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:11.701616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:11.710152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:11.712684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:11.714122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d4b89daa-3fd0-4099-86d4-7b9750729a7f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086229 Jul 29 06:44:11.714683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 944/1856] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:12.592031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:12.592703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:12.599573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:12.600094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:12.600858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:12.601316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:12.664833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:12.672722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-43c6d519-889d-42aa-a00f-da7f42f58c2b tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.084549 Jul 29 06:44:12.673285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 913/1857] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:12 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:12.736830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:12.737445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:12.744513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:12.744979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:12.745734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:12.746167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:12.808694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:12.817018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:12.818513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:12.819651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c7208857-bf9e-470b-b3c0-a8ae20f1a938 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086767 Jul 29 06:44:12.820363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 945/1858] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:13.693819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:13.694466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:13.701529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:13.701980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:13.702739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:13.703181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:13.764508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:13.771979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4a94ac68-f855-4835-ae47-9a5d26fbfed6 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082007 Jul 29 06:44:13.772546 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 914/1859] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:13 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:13.843833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:13.844478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:13.851122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:13.851574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:13.853004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:13.853453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:13.914217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:13.923425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:13.924940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:13.926077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ee391170-3eb1-4707-a57f-0fc10cd192c4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086097 Jul 29 06:44:13.926628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 946/1860] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:14.793982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:14.794598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:14.801160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:14.801612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:14.802371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:14.802804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:14.864521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:14.872606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7803cda1-e6fa-48e7-aa7a-835ff750d911 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083015 Jul 29 06:44:14.873171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 915/1861] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:14 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:14.949920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:14.950536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:14.957062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:14.957515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:14.958275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:14.958711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:15.022419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:15.031201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:15.032714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:15.033853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba3df8b6-8495-4c38-8102-e92fb5d4e0b9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089320 Jul 29 06:44:15.034396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 947/1862] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:15.893303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:15.893901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:15.900676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:15.901123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:15.901875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:15.902303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:15.963091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:15.970477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c699f703-51c6-49d1-a525-807f612538ef tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.080984 Jul 29 06:44:15.971035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 916/1863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:15 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:16.057624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:16.058168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:16.064732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:16.065189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:16.065965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:16.066405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:16.125835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:16.134094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:16.135596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:16.136854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2e443ef4-a9df-4f01-9181-c70143abbdb9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083703 Jul 29 06:44:16.137403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 948/1864] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:16.991899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:16.992433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:16.998910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:16.999365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:17.000131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:17.000621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:17.063002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:17.070440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-718b2453-79b2-46b6-84f4-4503e43e1ce8 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.082490 Jul 29 06:44:17.071525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 917/1865] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:16 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:17.159350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:17.159964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:17.166579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:17.167038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:17.167812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:17.168255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:17.231668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:17.239991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:17.241542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:17.243299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f77663bf-4299-4533-8193-9e4c3fc06fd9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087256 Jul 29 06:44:17.244034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 949/1866] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:18.092560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:18.093176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:18.099704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:18.100155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:18.100959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:18.101422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:18.165761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:18.172607 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8ca7c5ff-60a8-4b7e-b2c1-321eed1647dd tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.083954 Jul 29 06:44:18.173218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 918/1867] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:18 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:18.267549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:18.268139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:18.274892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:18.275344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:18.276112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:18.276565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:18.279577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:18.343395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:18.355096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:18.357898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:18.360151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45d80a25-5a75-42b5-8de0-de8d2c972dad tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.096444 Jul 29 06:44:18.360937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 950/1868] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:19.193883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:19.194495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:19.201170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:19.201616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:19.202369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:19.202805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:19.206605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:19.263827 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:19.271170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8e399518-36b0-4882-8e58-dc3801785478 tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081200 Jul 29 06:44:19.271756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 919/1869] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:19 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:19.389570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:19.390185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:19.396812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:19.408650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:19.408650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:19.408650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:19.463381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:19.471775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:19.473331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:19.474481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4570ee18-d7b2-487a-a780-2b7bcff1deb4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088817 Jul 29 06:44:19.475031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 951/1870] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:20.291283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:20.292028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] [instance: 0edc82ad-0d5b-4b12-b5fa-e69548ffd732] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:20.298529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:20.298983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:20.299750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:20.300187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:20.360467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d436bd35f48454da2dc2e607247fe02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b5916906d6048bb96c13c457bf367e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:20.368612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8a19c5a3-b504-49ea-a1ce-0b3315538c6e tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732" status: 200 len: 1213 microversion: 2.1 time: 0.081126 Jul 29 06:44:20.369051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 920/1871] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:44:20 2022] GET /compute/v2.1/servers/0edc82ad-0d5b-4b12-b5fa-e69548ffd732 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:44:20.497963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:20.498589 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:20.505833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:20.506346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:20.507303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:20.507890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:20.542101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5f7e7ea7-1c92-450d-8dff-b4e628e7072f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] Calling method '.version_select at 0x7f145e204dc0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:20.568722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5f7e7ea7-1c92-450d-8dff-b4e628e7072f tempest-TestShelveInstance-548416716 tempest-TestShelveInstance-548416716-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1134720923" status: 202 len: 0 microversion: 2.1 time: 0.030934 Jul 29 06:44:20.569742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 921/1872] 10.222.0.33 () {58 vars in 1254 bytes} [Fri Jul 29 06:44:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1134720923 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 06:44:20.584363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:20.593943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:20.595758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:20.596939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7f82007f-7511-4355-83b4-b6f73a34da51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.103216 Jul 29 06:44:20.597599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 952/1873] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:21.620619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:21.621360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:21.627619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:21.628080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:21.628892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:21.629324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:21.734245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:21.744196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:21.745854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:21.747130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2c126628-de44-4f63-9b7e-5cfae8cb5144 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.131653 Jul 29 06:44:21.748085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 922/1874] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:44:22.771472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:22.772183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:22.778719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:22.779180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:22.779985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:22.780427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:22.844478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:22.853119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:22.854632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:22.855783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-86d82827-3d8e-44f8-8d9f-14a831660e6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088294 Jul 29 06:44:22.856349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 953/1875] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:23.879929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:23.881258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:23.890420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:23.891542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:23.892884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:23.893539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:24.151216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:24.159630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:24.161230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:24.162458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1de7b8a2-eac1-4ebb-9c3b-a099a8e5ceff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.287016 Jul 29 06:44:24.163137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 923/1876] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:25.187188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:25.187797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:25.194798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:25.195264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:25.196117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:25.196599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:25.269383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:25.278154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:25.279664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:25.280876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-950f60d8-02f2-40d5-86a3-ae5a5ba10944 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.097648 Jul 29 06:44:25.281426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 954/1877] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:26.305021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:26.305754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:26.312103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:26.312618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:26.313331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:26.313765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:26.397192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:26.406179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:26.407675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:26.408837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-41cd4d37-69a1-421c-bf3a-2dbc9f8a2077 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.107728 Jul 29 06:44:26.409377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 924/1878] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:27.432056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:27.432995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:27.440692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:27.441178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:27.442301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:27.442832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:27.504676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:27.513616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:27.515413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:27.516596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-375b4b52-748d-4bc8-aa5c-8cef189d9f44 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089199 Jul 29 06:44:27.517156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 955/1879] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:44:28.540023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:28.540660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:28.543175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:28.548898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:28.549354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:28.550108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:28.550538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:28.615633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:28.624774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:28.626296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:28.627443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a053fdd3-ec2d-42ba-9630-fb97075e3c63 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091491 Jul 29 06:44:28.627997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 925/1880] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:29.651478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:29.652075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:29.654847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=48 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:29.660203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:29.660685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:29.661443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:29.661876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:29.723003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:29.731909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:29.733524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:29.734665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1f432ecb-7797-4a04-81ed-c30c9a0610ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087838 Jul 29 06:44:29.735221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 956/1881] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:30.757732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:30.758884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:30.765514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:30.765964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:30.766722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:30.767162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:30.828435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:30.837564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:30.839063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:30.840202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7b0a1c4a-bf30-46f6-9625-00b6963d3a25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086413 Jul 29 06:44:30.840786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 926/1882] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:31.863476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:31.864117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:31.871311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:31.871755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:31.872510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:31.872974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:31.936211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:31.944828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:31.947010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:31.948138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-40b2f0ff-33ba-4f50-9d3c-5e0a2bf6c2dd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088636 Jul 29 06:44:31.948734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 957/1883] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:32.971161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:32.971781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:32.978331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:32.979005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:32.979785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:32.980232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:33.041246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:33.049621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:33.051159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:33.052311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fb2132a5-0d26-4bae-99f0-3748003213cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084994 Jul 29 06:44:33.052892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 927/1884] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:34.075698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:34.076226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:34.082747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:34.083193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:34.083951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:34.084384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:34.357625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:34.365940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:34.368186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:34.369454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-400a2432-1e5d-4b04-b836-fe0b14b536d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.297740 Jul 29 06:44:34.370000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 958/1885] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:35.393416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:35.394029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:35.401442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:35.401898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:35.402661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:35.403099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:35.464265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:35.473655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:35.475150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:35.476298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b93bb74a-8834-42a3-bd00-efb684ca8c05 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086806 Jul 29 06:44:35.477918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 928/1886] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:36.500531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:36.501168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:36.508341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:36.508994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:36.510111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:36.510756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:36.573709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:36.582203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:36.583706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:36.584880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e0e1386-ff19-47ce-86a8-ad79d3b6fe38 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088298 Jul 29 06:44:36.585441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 959/1887] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:37.608760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:37.609401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:37.615900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:37.616351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:37.617878 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:37.618473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:37.682891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:37.691211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:37.692759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:37.693898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fccaef26-85ba-4f79-9068-bf88f7d7eebd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089071 Jul 29 06:44:37.694452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 929/1888] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:38.717338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:38.717893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:38.724698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:38.725155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:38.725953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:38.726806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:38.787405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:38.795805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:38.797321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:38.798451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e151d1a7-078b-423d-ace3-3e756c88ae46 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085171 Jul 29 06:44:38.799003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 960/1889] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:39.821546 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:39.822154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:39.828702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:39.829151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:39.829907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:39.830340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:39.890293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:39.899024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:39.900513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:39.901664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-36d4a9e6-e0b1-4b83-9d79-e1bc137cf6f6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084176 Jul 29 06:44:39.902210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 930/1890] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:40.926289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:40.926900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:40.934236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:40.934686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:40.935440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:40.935873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:41.004808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:41.013091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:41.014574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:41.015701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-61ae5e73-cc92-4d62-b02a-bc542eb9ff89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.093350 Jul 29 06:44:41.016247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 961/1891] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:42.038566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:42.039706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:42.046338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:42.046792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:42.047558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:42.047996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:42.109249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:42.118406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:42.119925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:42.121105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4e09d56f-d0eb-4b4a-863c-991383609977 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086583 Jul 29 06:44:42.121660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 931/1892] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:43.144495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:43.145143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:43.152192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:43.152674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:43.153430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:43.153861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:43.216594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:43.224857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:43.226367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:43.227499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f8346c7d-4280-4fd8-b27f-84f5be792db1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086908 Jul 29 06:44:43.228053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 962/1893] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:44.250459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:44.251074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:44.257704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:44.258313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:44.259080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:44.259521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:44.319818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:44.328417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:44.329941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:44.331087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c526b4ea-13b5-4841-8b88-ec018db290b1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084547 Jul 29 06:44:44.331641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 932/1894] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:45.355307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:45.355921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:45.362429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:45.362874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:45.363630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:45.364061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:45.424763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:45.434090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:45.435621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:45.436809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f6fa640a-edfd-46ee-bd87-895320c8a47f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085961 Jul 29 06:44:45.437363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 963/1895] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:44:46.459450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:46.460065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:46.467858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:46.468307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:46.469099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:46.469538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:46.533508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:46.542979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:46.544489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:46.545674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d446b8db-9433-40e9-b4c2-7695b43b9522 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090167 Jul 29 06:44:46.546452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 933/1896] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:47.568366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:47.569011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:47.575603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:47.576055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:47.576852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:47.577286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:47.637732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:47.646199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:47.647651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:47.648946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a95d6ab9-54eb-4374-9b2f-9a25d201f6d4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084451 Jul 29 06:44:47.649505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 964/1897] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:48.671866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:48.672480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:48.678998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:48.679967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:48.680771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:48.681212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:48.743788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:48.752153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:48.753687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:48.754914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4e08f066-0bb2-478b-8070-270fbc9def4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087034 Jul 29 06:44:48.755467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 934/1898] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:44:49.778986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:49.779604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:49.786206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:49.786661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:49.787431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:49.787870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:49.790863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=90 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:49.855233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:49.863560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:49.865065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:49.866193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8921359f-8a7c-42aa-a0bd-2cc787709493 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091171 Jul 29 06:44:49.867632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 965/1899] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:50.889895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:50.890536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:50.897085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:50.897536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:50.898375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:50.898777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:50.901323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=90 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:50.963208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:50.971660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:50.973563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:50.974706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a98b2d85-4992-41f3-bda5-c1a228e2f8cf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088800 Jul 29 06:44:50.975250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 935/1900] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:51.998400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:51.998928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:52.005033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:52.005485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:52.006256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:52.006699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:52.068325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:52.076978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:52.078475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:52.079626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-76cfc40d-4784-483d-8afa-829c08a65008 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085432 Jul 29 06:44:52.080184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 966/1901] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:53.103071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:53.103674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:53.110419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:53.110875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:53.111675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:53.112116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:53.172959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:53.181770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:53.183264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:53.184402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0e6069a4-7db4-482a-b8de-6869ce805b89 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085248 Jul 29 06:44:53.184989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 936/1902] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:54.207445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:54.208055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:54.215346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:54.215798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:54.216645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:54.217091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:54.277993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:54.286264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:54.287769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:54.289807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3af3dd5d-56e0-4934-99f7-cfa0bbb42166 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086223 Jul 29 06:44:54.290366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 967/1903] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:55.313472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:55.314014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:55.321254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:55.321705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:55.322473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:55.322914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:55.386915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:55.395465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:55.396985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:55.398204 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4ed9c56a-69ad-4934-ae8c-c95a9919dde3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088737 Jul 29 06:44:55.398757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 937/1904] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:56.420633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:56.421239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:56.427688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:56.428133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:56.429473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:56.429912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:56.492510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:56.500891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:56.502456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:56.503593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d3e3fc2-5b3a-445b-a750-e880180fc485 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086906 Jul 29 06:44:56.504137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 968/1905] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:57.527056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:57.527647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:57.534158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:57.534608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:57.535361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:57.535795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:57.599839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:57.609320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:57.610823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:57.611969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3a9f920b-2260-4f38-9245-e7e215458dc7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088817 Jul 29 06:44:57.612518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 938/1906] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:58.635895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:58.636591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:58.643047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:58.643505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:58.644272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:58.644766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:58.710978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:58.719697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:58.721222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:58.722367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ed4a04bb-dde3-4f3f-b309-a067133c3b5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091012 Jul 29 06:44:58.722917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 969/1907] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:44:59.747060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:44:59.747677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:44:59.750036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=28 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:44:59.755542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:59.755995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:59.756793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:44:59.757507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:44:59.818503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:59.827612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:59.829164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:44:59.830347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d55e3415-5245-46ce-aa36-4aa22db6d868 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087169 Jul 29 06:44:59.830899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 939/1908] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:44:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:00.853783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:00.854391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:00.856824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=28 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:00.862380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:00.862833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:00.863598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:00.864031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:00.924627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:00.933649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:00.935128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:00.936253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4f2197cb-a3dd-4f7c-bc39-fc9ef02aed13 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086494 Jul 29 06:45:00.936847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 970/1909] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:01.959591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:01.960214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:01.967488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:01.967934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:01.968714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:01.969152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:02.028944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:02.037298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:02.039307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:02.040434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-276a6b51-5fd7-4ad7-815f-ab1b191aeeff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084755 Jul 29 06:45:02.041014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 940/1910] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:03.063441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:03.063962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:03.071158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:03.071604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:03.072358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:03.072821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:03.132904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:03.141138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:03.142636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:03.143765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0f78ed8c-8b30-44e7-a182-2256e727ef4d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084350 Jul 29 06:45:03.144308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 971/1911] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:04.166778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:04.167393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:04.173980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:04.174441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:04.175208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:04.175648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:04.238008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:04.246360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:04.247870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:04.249054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-07df983e-ea28-46ea-9cd3-981f7f1602db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086255 Jul 29 06:45:04.249612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 941/1912] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:05.272917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:05.273787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:05.280299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:05.280784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:05.281557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:05.281998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:05.344259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:05.353330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:05.354837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:05.355979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca0c6168-1049-4b87-8428-c0faf53f8d3e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087533 Jul 29 06:45:05.356555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 972/1913] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:06.378379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:06.378973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:06.385553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:06.386001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:06.386755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:06.387187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:06.450883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:06.459213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:06.460758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:06.462172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe915df6-db41-4400-900b-d4856eacfeb3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087440 Jul 29 06:45:06.462727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 942/1914] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:07.484788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:07.485391 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:07.492476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:07.492948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:07.493707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:07.494134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:07.558253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:07.566990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:07.568485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:07.570569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-499b85eb-1e71-45f2-8e25-cf657fefd2a5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089624 Jul 29 06:45:07.571091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 973/1915] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:08.594055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:08.594650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:08.601552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:08.602060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:08.602830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:08.603363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:08.663646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:08.671964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:08.673466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:08.674599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-97f2d192-e9b5-43be-809b-bdd05cbf6912 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084476 Jul 29 06:45:08.675152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 943/1916] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:09.697868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:09.698483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:09.705044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:09.705494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:09.706259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:09.706694 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:09.771189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:09.780262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:09.781816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:09.782967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87dea76b-9674-4568-89f2-c95f7d8930a9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089655 Jul 29 06:45:09.783527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 974/1917] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:10.806708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:10.807246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:10.813721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:10.814185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:10.815189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:10.815624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:10.877453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:10.886426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:10.887921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:10.889155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8fedfd49-0315-4dfb-b167-b54495f70d18 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086491 Jul 29 06:45:10.889701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 944/1918] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:11.912676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:11.913869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:11.920366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:11.920839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:11.921595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:11.922027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:11.982006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:11.990292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:11.991717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:11.992870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ba156be-287e-4c92-8c9f-9c7208bef136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084088 Jul 29 06:45:11.993412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 975/1919] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:12.842104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:45:12.842547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:45:13.016114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:13.016721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:13.024370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:13.024840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:13.025609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:13.026046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:13.089672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:13.097945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:13.099453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:13.100912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5890aebf-205c-4183-8364-8bd7fc67dad9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088406 Jul 29 06:45:13.101535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 945/1920] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:14.123422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:14.124040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:14.130757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:14.131211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:14.132307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:14.132785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:14.194041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:14.202302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:14.203820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:14.205008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bdfe1f48-0aff-46b3-a625-2ae58790d3f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085531 Jul 29 06:45:14.205563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 976/1921] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:15.229282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:15.229894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:15.236413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:15.236899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:15.237662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:15.238100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:15.298592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:15.307015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:15.308510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:15.309672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7c44a013-c9df-4506-abb7-b87581003cfe tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084943 Jul 29 06:45:15.310224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 946/1922] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:16.332731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:16.333346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:16.340728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:16.341184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:16.341944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:16.342377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:16.406933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:16.415772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:16.417287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:16.418413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b71a7267-f6f9-4917-8e59-b7a8b799d97e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089660 Jul 29 06:45:16.418961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 977/1923] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:17.441107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:17.441723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:17.448154 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:17.448700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:17.449468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:17.449928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:17.511615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:17.519954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:17.521483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:17.523386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4cd09137-bda3-4cf7-b074-862f38b48182 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086079 Jul 29 06:45:17.523934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 947/1924] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:18.545972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:18.546586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:18.553097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:18.553752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:18.554524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:18.554963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:18.618098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:18.626898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:18.628398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:18.629564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ae2493e-dad0-49c8-957d-d49f8b73a7f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087508 Jul 29 06:45:18.630118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 978/1925] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:19.597662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:45:19.598201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:45:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:45:19.653467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:19.654079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:19.660558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:19.661021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:19.661778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:19.662214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:19.723529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:19.733435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:19.734521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:19.735673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd52b5a0-180f-4a18-8f8b-499375c57ffd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085996 Jul 29 06:45:19.736214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 948/1926] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:20.760120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:20.760753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:20.767254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:20.767699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:20.768598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:20.769201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:20.773290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=84 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:20.832338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:20.841932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:20.843436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:20.844604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-01507849-1aed-41e1-96a0-d0d59f2e3ff9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088898 Jul 29 06:45:20.845157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 979/1927] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:21.867266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:21.867884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:21.874420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:21.874880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:21.875647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:21.876090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:21.878644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=84 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:21.941388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:21.949775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:21.951293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:21.952436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e28df3ee-86ca-49b3-afb0-d8a1bdf1fafd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089151 Jul 29 06:45:21.953024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 949/1928] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:22.975605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:22.976378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:22.983215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:22.983633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:22.984392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:22.984860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:23.045625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:23.055048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:23.056581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:23.057724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a3e0af4c-3f7a-4b3a-a92c-e51a75dbc940 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086648 Jul 29 06:45:23.058280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 980/1929] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:24.079559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:24.080107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:24.086462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:24.087203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:24.087965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:24.088399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:24.148771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:24.157091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:24.158586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:24.159750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-750657c9-3c6b-4ea3-a0a9-babb6be48ed0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084239 Jul 29 06:45:24.160284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 950/1930] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:45:25.183233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:25.183852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:25.190400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:25.190857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:25.191630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:25.192072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:25.257166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:25.265471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:25.266984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:25.268136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a5865e74-80d9-45d2-b977-bd72af80c2db tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088837 Jul 29 06:45:25.268732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 981/1931] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:26.061861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:26.062436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:26.069560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:26.070016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:26.070791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:26.071229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:26.096438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:45:26.177610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e540d879-e522-44c1-b824-91cfc87d7c64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 204 len: 0 microversion: 2.1 time: 0.119408 Jul 29 06:45:26.178714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 951/1932] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:45:26 2022] DELETE /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:45:26.189388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:26.190013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:26.196575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:26.197043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:26.197811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:26.198255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:26.292527 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:26.293269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:26.299134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:26.299578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:26.300334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:26.300796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:26.325886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:26.333940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-77c8454a-73e1-46ec-a7f1-40b3d34f3d39 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150599 Jul 29 06:45:26.335143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 982/1933] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:26.363107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:26.371889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:26.373428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:26.374579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-27563f68-21eb-4d53-857f-3dbac5c25d36 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087147 Jul 29 06:45:26.375136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 952/1934] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:45:27.355936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:27.356531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:27.363031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:27.363475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:27.364229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:27.364702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:27.398520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:27.399128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:27.405784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:27.406231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:27.407001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:27.407434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:27.470537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:27.479512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:27.481030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:27.482440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b97318f5-f3d7-441e-886e-46d864e36771 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089172 Jul 29 06:45:27.483142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 953/1935] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:45:27.500939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:27.509805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c9714508-1977-4aae-8432-fd88d458ad9c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.157720 Jul 29 06:45:27.510370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 983/1936] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:28.505406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:28.506017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:28.512901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:28.513356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:28.514157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:28.514593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:28.531063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:28.531819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:28.538914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:28.539359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:28.540122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:28.540576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:28.580312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:28.589764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:28.591271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:28.592421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f8e8394e-8bda-48ba-b69a-f56f1a09780e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090957 Jul 29 06:45:28.593214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 954/1937] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:28.668973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:28.677679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-83627ab9-167a-4f8b-b686-efd87af3f2e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150306 Jul 29 06:45:28.678257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 984/1938] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:45:29.616659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:29.617322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:29.623721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:29.624177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:29.624975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:29.625419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:29.688098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:29.696511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:29.698035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:29.699182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5ceee9c5-f1df-481e-9883-b0c13deb7ae7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087200 Jul 29 06:45:29.699392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:29.699870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 955/1939] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:29.699985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:29.706521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:29.706964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:29.707730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:29.708164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:29.837913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:29.845848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3985fbef-197d-40bf-af36-a8feb5e26a96 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150332 Jul 29 06:45:29.846398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 985/1940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:45:30.721692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:30.722300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:30.724835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:30.730085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:30.730537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:30.731304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:30.731748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:30.792810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:30.801091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:30.802581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:30.804334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5ff19103-59fe-4046-9020-dd44ac8d5c28 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086514 Jul 29 06:45:30.804903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 956/1941] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:30.868154 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:30.868807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:30.871152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=32 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:30.876472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:30.876954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:30.877719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:30.878159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:31.008969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:31.016872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a5d1a757-cfa4-42d5-8de4-23edae419974 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153588 Jul 29 06:45:31.017425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 986/1942] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:31.827282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:31.827892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:31.834987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:31.835440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:31.836194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:31.836658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:31.897158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:31.905455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:31.906962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:31.908100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-577d4107-4f93-4b7c-9d48-0ceed26ec757 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084719 Jul 29 06:45:31.908676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 957/1943] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:32.038111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:32.038653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:32.045254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:32.045703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:32.046460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:32.046892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:32.176577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:32.185712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b8b11ea0-2067-47ab-b348-58a41e2ed0ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151429 Jul 29 06:45:32.186286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 987/1944] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:32.931807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:32.932409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:32.938855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:32.939303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:32.940052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:32.940486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:33.003073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:33.012278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:33.013841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:33.014976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d11d4dab-6200-4d8b-96fc-669b0c06a35b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087647 Jul 29 06:45:33.015526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 958/1945] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:33.207507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:33.208122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:33.215138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:33.215592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:33.216352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:33.216822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:33.343204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:33.351863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-385719ac-c87a-4612-8939-ea7599f95cf5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148177 Jul 29 06:45:33.352423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 988/1946] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:34.038085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:34.038650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:34.045163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:34.045626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:34.046398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:34.046843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:34.108082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:34.116740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:34.118257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:34.119405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e4558fdc-da8c-43f1-ba4d-538d1cdd7a3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085394 Jul 29 06:45:34.120147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 959/1947] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:34.372761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:34.373375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:34.379835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:34.380283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:34.381674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:34.382114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:34.507413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:34.515288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-12d24de8-a65b-4fb8-aa20-c31d4da04375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146365 Jul 29 06:45:34.515855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 989/1948] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:35.142965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:35.143571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:35.150534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:35.150977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:35.151728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:35.152183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:35.212348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:35.220519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:35.222045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:35.223181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d6be07c6-6ae8-4c7c-90f2-2aaab855b6c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084125 Jul 29 06:45:35.223730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 960/1949] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:35.537657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:35.538914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:35.545509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:35.545973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:35.546737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:35.547169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:35.683924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:35.692062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-77bbaf03-57c5-467f-b900-850d81c31863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158851 Jul 29 06:45:35.692647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 990/1950] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:36.246796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:36.247436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:36.253943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:36.254388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:36.255145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:36.255582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:36.316429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:36.325083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:36.326604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:36.327754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f031ca6b-6a7f-438a-ab53-c708a5b1ede3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084888 Jul 29 06:45:36.328311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 961/1951] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:36.714542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:36.715159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:36.721749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:36.722198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:36.722966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:36.723406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:36.857104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:36.865041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d76ddf5-9cab-4561-b77c-69054c63f890 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154626 Jul 29 06:45:36.866312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 991/1952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:37.351477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:37.352095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:37.358661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:37.359113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:37.359877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:37.360311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:37.426571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:37.435923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:37.437456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:37.438595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-66065dfa-8017-400e-96f8-0dc32b8a89e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091317 Jul 29 06:45:37.439145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 962/1953] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:37.886734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:37.887348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:37.894121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:37.894602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:37.895466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:37.895944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:38.027452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:38.035310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4ee0534d-5c24-489a-a2bf-b3aafbcc1b56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152430 Jul 29 06:45:38.035875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 992/1954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:38.464828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:38.465633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:38.472501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:38.472984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:38.473957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:38.474345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:38.536745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:38.545186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:38.546683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:38.547826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-88bbc141-db06-4435-92d4-36fff512d430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087427 Jul 29 06:45:38.548376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 963/1955] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:39.058058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:39.058600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:39.065121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:39.065574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:39.066342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:39.066784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:39.197522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:39.205437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85f6f57f-d13b-4e5e-9315-dcdd8613f5c6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151442 Jul 29 06:45:39.206001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 993/1956] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:39.570615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:39.571224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:39.577726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:39.578167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:39.578916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:39.579344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:39.583212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:39.641333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:39.650082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:39.651578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:39.652759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1c424925-e569-4729-8a9d-614350109a59 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086063 Jul 29 06:45:39.653315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 964/1957] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:40.226451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:40.227000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:40.233544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:40.233998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:40.234770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:40.235213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:40.363531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:40.372023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b148cd54-e1e3-4fb1-a237-19c76775f633 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149704 Jul 29 06:45:40.372587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 994/1958] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:40.676045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:40.676678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:40.683710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:40.684153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:40.684999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:40.685433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:40.746631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:40.755060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:40.756636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:40.757775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-57fb1b9c-3010-47ff-9d9e-929a0b4dbcbb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085634 Jul 29 06:45:40.758324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 965/1959] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:41.393791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:41.394390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:41.400846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:41.401292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:41.402046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:41.402479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:41.531477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:41.533676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:41.541292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2c063121-2e63-4ee6-a554-6b6113bf8380 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151353 Jul 29 06:45:41.541853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 995/1960] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:41.780847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:41.781484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:41.788440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:41.788913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:41.789670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:41.790104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:41.854147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:41.862589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:41.864088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:41.866468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8ae17aa4-7516-4584-8073-0dc1ed477bcb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089200 Jul 29 06:45:41.867031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 966/1961] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:42.563025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:42.563617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:42.570308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:42.570752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:42.571502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:42.571930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:42.698388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:42.706747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-47bb35ea-8779-4830-aad1-6b54a2341632 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147704 Jul 29 06:45:42.707239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 996/1962] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:42.889880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:42.890494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:42.897552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:42.897999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:42.898760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:42.899201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:42.958540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:42.967636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:42.969167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:42.970309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-50b8886c-7a71-446d-8264-9c72659b8aeb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084478 Jul 29 06:45:42.970863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 967/1963] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:43.729205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:43.729820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:43.736501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:43.736981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:43.737750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:43.738186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:43.863609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:43.872022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-648efb7a-6601-4618-826a-70984bc9ccb3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147519 Jul 29 06:45:43.872604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 997/1964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:43.994109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:43.994646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:44.001138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:44.001592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:44.002363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:44.002804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:44.065976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:44.074712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:44.076214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:44.077406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-da961c3c-71ac-4dc5-8916-21318a1718c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087687 Jul 29 06:45:44.077971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 968/1965] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:44.893602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:44.894491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:44.901794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:44.902249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:44.903017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:44.903462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:45.033880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:45.042443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ba19312-acf2-4b9c-b8b2-e71b416dc018 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152756 Jul 29 06:45:45.042997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 998/1966] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:45.100592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:45.101206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:45.107752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:45.108212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:45.109017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:45.109460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:45.169407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:45.177701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:45.179207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:45.180353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a710d149-70be-42e3-88ad-ed52c532af23 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084234 Jul 29 06:45:45.180942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 969/1967] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:46.063295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:46.063826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:46.070428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:46.070883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:46.071645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:46.072085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:46.196974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:46.202784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:46.203406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:46.205008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba298a6e-16a5-4c01-aa67-1e207fafb82d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.145612 Jul 29 06:45:46.205577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 999/1968] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:46.209786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:46.210235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:46.210994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:46.211426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:46.275545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:46.283757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:46.285294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:46.286435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bd17a5d4-7036-4e79-87ae-6665e50027b0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087476 Jul 29 06:45:46.287662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 970/1969] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:45:47.227650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:47.228197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:47.234732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:47.235198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:47.235967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:47.236412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:47.309646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:47.310349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:47.316842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:47.317298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:47.318070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:47.318511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:47.373340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:47.379744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:47.381751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-feed5308-1651-4613-afbe-035de5c27c84 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158599 Jul 29 06:45:47.382333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1000/1970] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:47.388320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:47.389864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:47.391018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f5c21e8e-76a0-4ac1-b857-16657570aca1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085365 Jul 29 06:45:47.391565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 971/1971] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:45:48.403060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:48.403691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:48.410263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:48.410721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:48.411498 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:48.412466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:48.415849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:48.416459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:48.423031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:48.423478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:48.424247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:48.424717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:48.487523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:48.496709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:48.498371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:48.499542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eb5489f8-d5d9-4db0-a07d-c9623d7306f1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088301 Jul 29 06:45:48.500317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 972/1972] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:45:48.543100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:48.551169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c8521e2-ad5d-4520-a5f8-16dabad6bd9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151915 Jul 29 06:45:48.551751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1001/1973] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:49.522522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:49.523131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:49.529558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:49.530016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:49.530775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:49.531205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:49.572776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:49.573422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:49.580086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:49.580656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:49.581555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:49.582062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:49.591621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:49.601063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:49.602578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:49.604076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-15b6d4f4-bfa3-49b4-8480-eb05341598e7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086117 Jul 29 06:45:49.604907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 973/1974] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:49.709978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:49.718209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b94244dd-2635-4486-8f2b-5ac664604e70 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149816 Jul 29 06:45:49.718777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1002/1975] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:45:50.626742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:50.627447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:50.634545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:50.634996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:50.635763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:50.636198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:50.700183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:50.709150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:50.710653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:50.711797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d6a37921-2d93-4365-9d57-2f7b45eb834d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088999 Jul 29 06:45:50.712632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 974/1976] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:50.739136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:50.739959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:50.746437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:50.746982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:50.747816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:50.748261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:50.880945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:50.889383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05168972-7a39-461c-beae-28041f5c7553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154120 Jul 29 06:45:50.889952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1003/1977] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:51.735272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:51.735907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:51.742759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:51.743205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:51.743959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:51.744391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:51.806735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:51.814996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:51.816488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:51.817656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-950d5e06-285a-4156-8564-6b8d41e5c043 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086269 Jul 29 06:45:51.818285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 975/1978] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:51.910456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:51.911092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:51.918317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:51.918759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:51.919512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:51.919944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:52.044926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:52.052908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e4fc1103-9edc-4d68-80ee-e3fe0e29f099 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146219 Jul 29 06:45:52.053470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1004/1979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:45:52.840249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:52.840949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:52.847404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:52.847849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:52.848625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:52.849133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:52.909320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:52.917692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:52.919177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:52.920312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a0feb9d2-8d25-4c0e-bd29-18b38591f3a1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084357 Jul 29 06:45:52.920901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 976/1980] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:53.074545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:53.075149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:53.081581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:53.082028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:53.082785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:53.083244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:53.216911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:53.225344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f7fe7343-ae27-4b83-8afb-f596dee82370 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154676 Jul 29 06:45:53.225913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1005/1981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:53.943891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:53.944465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:53.950459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:53.950906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:53.951655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:53.952089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:54.011839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:54.020138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:54.022028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:54.023180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-29710df2-3d68-4d63-a777-72c52f1a5709 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084030 Jul 29 06:45:54.023744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 977/1982] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:54.246959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:54.247566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:54.254107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:54.254559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:54.255410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:54.255820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:54.387477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:54.395287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45b10959-de6d-4962-9d27-2b955749a151 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152226 Jul 29 06:45:54.396086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1006/1983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:55.045994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:55.046534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:55.054039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:55.054497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:55.055273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:55.055718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:55.119037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:55.127379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:55.128933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:55.130079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c2e1cecf-0808-470b-b69f-8c9a6de76f5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088128 Jul 29 06:45:55.130740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 978/1984] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:55.416301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:55.416968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:55.423398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:55.423846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:55.424628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:55.425095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:55.556606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:55.564555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ad520b10-cc35-4227-9fc9-959f088f03ad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152889 Jul 29 06:45:55.565125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1007/1985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:56.152777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:56.153411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:56.159892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:56.160344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:56.161126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:56.161817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:56.222214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:56.230888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:56.232393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:56.233570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4ee4be03-10c6-48b7-b20b-6f4daca76abb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084888 Jul 29 06:45:56.234130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 979/1986] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:56.585728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:56.586351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:56.593111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:56.593566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:56.594339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:56.594780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:56.721880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:56.730841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-93db1854-b447-445b-b898-8df499db38c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149020 Jul 29 06:45:56.731418 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1008/1987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:57.257646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:57.258185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:57.264739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:57.265198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:57.265963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:57.266399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:57.328927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:57.331104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:45:57.339532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:57.341069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:57.342245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d9602c79-2a3f-47ec-86c5-4769bcc1790d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089543 Jul 29 06:45:57.342797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 980/1988] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:57.752714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:57.753327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:57.760433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:57.760912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:57.761678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:57.762115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:57.888878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:57.896774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-03222044-f1eb-45ba-8214-8d49b413e83f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147944 Jul 29 06:45:57.897426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1009/1989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:58.365692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:58.366296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:58.372881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:58.373332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:58.374085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:58.374520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:58.435354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:58.443643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:58.445189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:58.446340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f604562c-8a44-49fc-940f-baaa143ee60f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084790 Jul 29 06:45:58.446894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 981/1990] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:45:58.918547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:58.919181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:58.925690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:58.926140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:58.926921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:58.927354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:59.056468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:59.064408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e7da63cd-a9d1-4534-95d5-99902c39d342 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149819 Jul 29 06:45:59.065007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1010/1991] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:45:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:45:59.470227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:45:59.470849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:45:59.477375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:59.477828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:59.478593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:45:59.479031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:45:59.545269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:59.553834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:59.555543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:45:59.556730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-26a87f1c-43d9-4c0d-87d2-f2393d30f4c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090411 Jul 29 06:45:59.557287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 982/1992] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:45:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:00.087508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:00.088129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:00.094645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:00.095098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:00.095861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:00.096300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:00.222622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:00.231073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-820fd68e-310b-471c-b91e-ac56574b2e09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148309 Jul 29 06:46:00.231628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1011/1993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:00.579305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:00.579882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:00.587536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:00.588013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:00.588809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:00.589245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:00.650676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:00.659028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:00.660526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:00.661691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7e143ebd-5c00-456a-9e81-60129b4bf059 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086373 Jul 29 06:46:00.662245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 983/1994] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:01.252763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:01.253379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:01.255708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=52 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:01.261683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:01.262134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:01.262907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:01.263350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:01.278831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:01.393963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:01.402072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cd38045f-b99f-4b9b-aecb-cc7c7b097de9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153216 Jul 29 06:46:01.402639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1012/1995] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:01.685312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:01.685917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:01.688165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=56 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:01.693551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:01.694004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:01.694759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:01.695235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:01.755665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:01.764321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:01.765848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:01.766996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-607a0d6e-b036-4c25-92df-38f71c3ae0fc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085598 Jul 29 06:46:01.767530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 984/1996] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:02.423168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:02.423763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:02.430919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:02.431363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:02.432128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:02.432585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:02.562641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:02.571012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af6d29d2-9174-44f0-bd94-f1671ee5b77e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151737 Jul 29 06:46:02.571562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1013/1997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:02.789880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:02.790490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:02.797010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:02.797463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:02.798231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:02.798668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:02.861614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:02.870671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:02.872177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:02.873348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-80ca2ff1-48dd-4bfb-9c49-4a25e02a4a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087856 Jul 29 06:46:02.873899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 985/1998] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:03.593160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:03.593779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:03.600229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:03.600724 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:03.602083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:03.602519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:03.728860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:03.736798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9fd04f2b-0e8c-4658-be2e-b3877d789160 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147487 Jul 29 06:46:03.737357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1014/1999] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:03.896581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:03.897197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:03.904341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:03.904826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:03.905589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:03.906032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:03.969260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:03.977883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:03.979491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:03.980706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9cfa3a01-b1d8-4515-b7a4-715e7b15606a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087967 Jul 29 06:46:03.981265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 986/2000] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:04.758450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:04.759055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:04.765649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:04.766094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:04.766853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:04.767288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:04.897262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:04.907179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-14281ee7-2f1c-45e2-bd01-85b0cd14da1a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153183 Jul 29 06:46:04.907744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1015/2001] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:05.003406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:05.003948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:05.011016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:05.011467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:05.012227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:05.012698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:05.072593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:05.080842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:05.082411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:05.083557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-020d9c8b-d5c3-4e7b-b89c-570b20ab9e3c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084486 Jul 29 06:46:05.084111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 987/2002] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:05.927205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:05.927819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:05.935264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:05.935717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:05.936486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:05.936961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:06.064709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:06.073133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bfc1dd45-c080-4570-8554-872330646273 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149838 Jul 29 06:46:06.073700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1016/2003] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:06.106070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:06.106679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:06.113291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:06.113745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:06.114508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:06.114943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:06.178210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:06.186462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:06.187947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:06.189126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-12ea622f-dc6c-4aac-aeb8-ea2ce9eef3ac tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086931 Jul 29 06:46:06.189674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 988/2004] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:07.094506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:07.095115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:07.101772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:07.102224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:07.102982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:07.103417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:07.212705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:07.213325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:07.219765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:07.220222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:07.221021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:07.221464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:07.235245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:07.243224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-718b4a7e-086f-47b1-96b7-32165817abad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152571 Jul 29 06:46:07.243809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1017/2005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:07.282544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:07.290795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:07.292273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:07.293433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-23abfa43-05c4-4aaf-993e-14ddf304fa9b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085979 Jul 29 06:46:07.294667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 989/2006] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:08.264167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:08.264810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:08.271334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:08.271789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:08.272575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:08.273541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:08.317462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:08.318084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:08.324597 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:08.325057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:08.325899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:08.326600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:08.398843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:08.402624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:08.407761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:08.409285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:08.410447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bc1a4949-717c-4eea-86f2-315a6898a739 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150143 Jul 29 06:46:08.410578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3987964c-652f-4593-83d1-305f220eb886 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.096874 Jul 29 06:46:08.411268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 990/2008] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:08.411406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1018/2008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:09.432779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:09.433396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:09.434133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:09.434753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:09.440080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:09.440566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:09.441165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:09.441349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:09.441628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:09.441794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:09.442402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:09.442844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:09.504972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:09.513462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:09.514949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:09.516085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6ab79769-2dec-4c99-afbf-245175ad71c1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085999 Jul 29 06:46:09.516670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1019/2009] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:09.571404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:09.579648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-902ff0a5-428e-4377-b385-28944b7faa56 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151447 Jul 29 06:46:09.580241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 991/2010] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:10.539144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:10.539765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:10.546407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:10.546863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:10.547638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:10.548084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:10.602643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:10.603253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:10.609815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:10.610273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:10.611055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:10.612212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:10.614148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:10.622768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:10.624274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:10.625453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f19d59be-4e9e-4fcc-88e1-301dad16730c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090933 Jul 29 06:46:10.626010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1020/2011] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:10.739281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:10.747163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a1a22fc5-0f6f-4b2e-ac52-b5c9a4da1720 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148920 Jul 29 06:46:10.747734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 992/2012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:11.648782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:11.649411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:11.655774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:11.656245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:11.657053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:11.657496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:11.717526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:11.726071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:11.727774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:11.728940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ae245dc8-e3c8-4d84-b219-513f8a528f3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084671 Jul 29 06:46:11.729497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1021/2013] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:11.769257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:11.769875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:11.777053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:11.777500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:11.778260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:11.778688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:11.907951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:11.915959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e981cc05-aafb-46ca-97a8-3c9887fbc5a3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150813 Jul 29 06:46:11.916514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 993/2014] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:12.751377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:12.751973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:12.758511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:12.759530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:12.760297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:12.760768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:12.820628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:12.829469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:12.830979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:12.832118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dd6e7d1f-43f7-4a11-8fd4-41534f5b589a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084810 Jul 29 06:46:12.832712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1022/2015] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:12.937846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:12.938452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:12.944851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:12.945301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:12.946659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:12.947101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:13.072516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:13.080347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6926c78e-ab3b-4d01-8656-1a1412e9f0dd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146404 Jul 29 06:46:13.080946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 994/2016] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:13.857676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:13.858285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:13.864843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:13.865291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:13.866047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:13.866481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:13.926618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:13.935660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:13.937184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:13.938317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-49276119-8889-4637-8ac1-3989e0edc5ef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084536 Jul 29 06:46:13.938868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1023/2017] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:14.101669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:14.102930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:14.109479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:14.109938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:14.110706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:14.111147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:14.495454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:14.503254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-edc67dc1-39b4-45a8-a40e-f6e09ba1ee6a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.405438 Jul 29 06:46:14.503814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 995/2018] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:14.960802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:14.961400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:14.969019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:14.969463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:14.970218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:14.970659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:15.033879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:15.042113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:15.043599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:15.044761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a96d3dc9-ff5d-4da6-8e9f-3dd07cb0f3f7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087901 Jul 29 06:46:15.045314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1024/2019] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:15.524952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:15.525826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:15.532312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:15.532805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:15.533572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:15.534011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:15.658224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:15.666640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6379368e-c256-4031-9fc8-8b6f2dec04f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.145561 Jul 29 06:46:15.667201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 996/2020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:16.068483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:16.069117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:16.075632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:16.076094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:16.076925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:16.077362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:16.138180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:16.146634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:16.148170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:16.150066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7b669ac1-6958-41ab-b690-fec8936409c8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084800 Jul 29 06:46:16.150780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1025/2021] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:16.687188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:16.687815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:16.694372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:16.694816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:16.695566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:16.696055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:16.713334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:16.828228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:16.836077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b636c33c-edc5-4a3c-9484-3f16f00efe81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152748 Jul 29 06:46:16.837432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 997/2022] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:17.174148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:17.174765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:17.181341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:17.181791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:17.182566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:17.183007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:17.245715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:17.254066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:17.255575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:17.256754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8c3ab926-0d82-4df7-9b14-b892d2cfa82f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086570 Jul 29 06:46:17.257327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1026/2023] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:17.858577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:17.859185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:17.865712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:17.866158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:17.866985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:17.867330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:17.994081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:18.001973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-31e68133-8fdb-42b7-b149-8c6dedca5447 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147282 Jul 29 06:46:18.002534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 998/2024] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:18.280580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:18.281133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:18.287742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:18.288202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:18.289007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:18.289449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:18.349845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:18.359358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:18.362317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:18.364510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b00a3c07-e968-4d58-bd35-2c8e55940831 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087587 Jul 29 06:46:18.365591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1027/2025] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:19.023030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:19.023570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:19.030283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:19.030726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:19.031482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:19.031916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:19.158882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:19.167208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2a602965-955a-4064-bacb-18462f0d9ebb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148124 Jul 29 06:46:19.167784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 999/2026] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:19.387518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:19.388138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:19.394709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:19.395165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:19.395934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:19.396377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:19.461297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:19.469962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:19.471452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:19.472607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73028df5-edf5-4ade-a3f9-c054444a1f85 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088864 Jul 29 06:46:19.473159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1028/2027] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:20.189622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:20.190248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:20.197710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:20.198148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:20.198914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:20.199348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:20.334857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:20.344871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5b555ba0-412e-41fc-88db-4be5a895352a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158976 Jul 29 06:46:20.345536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1000/2028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:20.495674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:20.496361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:20.502812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:20.503271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:20.504045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:20.504529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:20.507217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:20.572890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:20.582185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:20.583755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:20.584915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-26fd84ab-6721-477c-a863-0665866dcfe3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.093478 Jul 29 06:46:20.585490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1029/2029] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:21.366724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:21.367343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:21.374079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:21.374533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:21.375301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:21.375746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:21.512567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:21.520770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c0a30dee-829c-4c8d-b7a9-e60949a3b149 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.157866 Jul 29 06:46:21.521343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1001/2030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:21.609633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:21.610247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:21.616397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:21.616925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:21.617640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:21.618076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:21.677357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:21.685828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:21.687362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:21.688515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-995e6381-5f0e-4502-ac21-2558d176970b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.082770 Jul 29 06:46:21.689075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1030/2031] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:22.543756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:22.544370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:22.550815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:22.551260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:22.552012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:22.552445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:22.683613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:22.691422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca5e125e-ee15-4ed1-b493-893aab613b16 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152222 Jul 29 06:46:22.691978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1002/2032] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:22.711331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:22.712046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:22.718749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:22.719204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:22.719975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:22.720419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:22.781489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:22.790142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:22.791652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:22.792832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a2e6f12-60b4-48e3-b602-f70334ee008d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085343 Jul 29 06:46:22.793393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1031/2033] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:23.713558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:23.714166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:23.720749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:23.721202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:23.721967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:23.722399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:23.815230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:23.815851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:23.823114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:23.823573 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:23.824390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:23.824869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:23.853311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:23.861258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-949b5e6e-4766-42b0-9571-fb09fff6deac tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151829 Jul 29 06:46:23.861832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1003/2034] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:23.889757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:23.898145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:23.900283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:23.901433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e186266f-fd2d-4309-8794-08e776a1e70c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090127 Jul 29 06:46:23.901989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1032/2035] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:24.882581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:24.883199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:24.890481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:24.890938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:24.891703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:24.892147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:24.924146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:24.924913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:24.932028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:24.932804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:24.933590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:24.934033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:25.000092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:25.008593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:25.010766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:25.011988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c025a57-53b5-42c8-a2bf-a03f5e633a77 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091738 Jul 29 06:46:25.012565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1033/2036] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:25.019858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:25.028042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d3bed868-ef74-424d-980b-6a470f0168b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149363 Jul 29 06:46:25.028618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1004/2037] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:26.034655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:26.035197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:26.041910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:26.042364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:26.043134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:26.043575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:26.048231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:26.048890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:26.055308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:26.055759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:26.056717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:26.057421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:26.105547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:26.114018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:26.115513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:26.116684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c9ba8ec7-2c18-4c76-ba6d-e00fdf2b4d25 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085977 Jul 29 06:46:26.117238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1034/2038] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:26.187484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:26.195308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-db394491-2bd5-41bc-9e79-b5d74c734826 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150997 Jul 29 06:46:26.195999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1005/2039] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:27.139906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:27.140514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:27.147180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:27.147626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:27.148385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:27.148849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:27.209604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:27.217353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:27.217959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:27.218516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:27.220020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:27.221205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f5090129-d3ac-40ac-861c-b57ed1c03b2c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085403 Jul 29 06:46:27.221760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1035/2040] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:27.224704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:27.225159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:27.225941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:27.226372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:27.352270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:27.360164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9e01d19e-a328-4ba5-b5a5-1771c39108d1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146567 Jul 29 06:46:27.360758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1006/2041] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:28.244461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:28.245103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:28.251587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:28.252038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:28.252832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:28.253273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:28.381305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:28.381926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:28.388503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:28.388987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:28.389769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:28.390210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:28.476788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:28.487321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:28.489362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:28.490494 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b4e1c5d8-1e6a-4a59-93d6-70bfec970287 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.250505 Jul 29 06:46:28.491270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1036/2042] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:28.528400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:28.536627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d48f7571-935c-49ea-9e62-8f6eed6d2566 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.159125 Jul 29 06:46:28.537270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1007/2043] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:29.515084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:29.515682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:29.522218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:29.522668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:29.523438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:29.523876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:29.558742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:29.559381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:29.565922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:29.566373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:29.567372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:29.567809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:29.586344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:29.595177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:29.596715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:29.597866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-923e52df-022b-4001-911b-e64d7d37dab9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086732 Jul 29 06:46:29.598428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1037/2044] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:29.786746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:29.794591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-17287bb2-7847-4dde-b39b-307e5d6617c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.240248 Jul 29 06:46:29.795152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1008/2045] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:30.621623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:30.622248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:30.628794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:30.629252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:30.630020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:30.630464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:30.693114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:30.701510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:30.703019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:30.704160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2816d916-b404-4a9f-b2bc-fe36e8d1d86b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087353 Jul 29 06:46:30.704756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1038/2046] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:30.815444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:30.816052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:30.823111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:30.823560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:30.824315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:30.824776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:30.954420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:30.962503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c7c52844-6672-43b4-997d-312ac1194455 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150660 Jul 29 06:46:30.963167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1009/2047] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:31.726866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:31.727475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:31.730773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=54 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:31.736242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:31.736732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:31.737507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:31.737943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:31.799216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:31.808346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:31.809935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:31.811090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-64bb5cff-7dca-4bc4-9180-df08a55ebbfb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088120 Jul 29 06:46:31.811693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1039/2048] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:31.983899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:31.984525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:31.986936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=52 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:31.992345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:31.992826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:31.993584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:31.994105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:32.121520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:32.129435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2c735d92-6e66-4f90-a30f-bf2f103fe737 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149447 Jul 29 06:46:32.129992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1010/2049] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:32.834193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:32.834810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:32.842389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:32.842833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:32.843586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:32.844017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:32.910383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:32.919087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:32.920608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:32.921776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-90a027b7-9417-4eae-a047-6f539ece4e74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091528 Jul 29 06:46:32.922359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1040/2050] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:33.152248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:33.152991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:33.159862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.160383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.161314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.162000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.169137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:33.169639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:33.175534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.175990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.176980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.177421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.192698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] HTTP exception thrown: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Request method failure captured: Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 HTTP/1.1 Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432fxti8pbSYNfIk9o3lK909ucRXvyHrKqmpzH9oVvs2UiIFjuM9RqA0LRKHJmDJki-jYaMr1eW0A7kaPPUOrHe5w0hKPz02vAQrlHG--dcHNwUWwC56fAw_IhnWIDsRH69WhGM9qDTfRMslQNBnMWUE6fnuZ8CgyqP4ABLUZUUeC2c Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:46:33.194461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3b773b1bba540f79c21b042d5cf91de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: e1b9767f26254a6cba945f4cae562b70 Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.195888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'c1670afa-b434-47b5-a7d8-88464f5bd861'} Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:46:33.196740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.200440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.204069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Returning 404 to user: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:46:33.204069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ce2e81ec-fe67-435b-9b90-dac51ef2d323 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 404 len: 111 microversion: 2.1 time: 0.031036 Jul 29 06:46:33.204069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1041/2051] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:46:33 2022] DELETE /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 06:46:33.204884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:33.205700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c1670afa-b434-47b5-a7d8-88464f5bd861] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:33.211773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.212776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.213775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.214408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.230653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] HTTP exception thrown: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Request method failure captured: Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 HTTP/1.1 Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432fxti8pbSYNfIk9o3lK909ucRXvyHrKqmpzH9oVvs2UiIFjuM9RqA0LRKHJmDJki-jYaMr1eW0A7kaPPUOrHe5w0hKPz02vAQrlHG--dcHNwUWwC56fAw_IhnWIDsRH69WhGM9qDTfRMslQNBnMWUE6fnuZ8CgyqP4ABLUZUUeC2c Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:46:33.232275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3b773b1bba540f79c21b042d5cf91de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: e1b9767f26254a6cba945f4cae562b70 Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.233711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'c1670afa-b434-47b5-a7d8-88464f5bd861'} Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:46:33.234482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. Jul 29 06:46:33.235783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:46:33.237036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Returning 404 to user: Instance c1670afa-b434-47b5-a7d8-88464f5bd861 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:46:33.237036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2dc796ec-7505-4969-802b-d10009e491b1 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861" status: 404 len: 111 microversion: 2.1 time: 0.032815 Jul 29 06:46:33.237036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1042/2052] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:33 2022] GET /compute/v2.1/servers/c1670afa-b434-47b5-a7d8-88464f5bd861 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:46:33.305792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:33.314716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-80084eaa-3f5a-47c2-b935-06f1818c618b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.167374 Jul 29 06:46:33.315279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1011/2053] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:33.944966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:33.945577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:33.952149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.952653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:33.953408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:33.953839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:34.013975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:34.022307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:34.023786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:34.025491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-67f3c4d8-3bd2-41d2-92ac-48de20e6454b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083822 Jul 29 06:46:34.026222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1043/2054] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:34.337405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:34.338689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:34.345129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:34.345572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:34.346327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:34.346756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:34.447928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:46:34.448245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:46:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:46:34.487530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:34.495630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f768095d-9569-49ad-98dc-65a9c8267230 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.162277 Jul 29 06:46:34.496193 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1012/2055] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:35.048528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:35.049083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:35.055597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:35.056041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:35.057439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:35.057871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:35.117509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:35.126324 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:35.127816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:35.128961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-800fb1c1-bb10-4768-bc46-49b8abc3b140 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084458 Jul 29 06:46:35.129529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1044/2056] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:35.516564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:35.517192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:35.523577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:35.524024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:35.524814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:35.525756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:35.650813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:35.658719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-764f3fdc-e9d4-4bfa-afde-3b2a1c7bab68 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.145958 Jul 29 06:46:35.659294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1013/2057] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:36.152746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:36.153295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:36.159789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:36.160370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:36.161167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:36.161609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:36.223583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:36.232634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:36.234183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:36.235332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e1b9fe8-219a-4ca4-b888-7bd6c28d48cd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087739 Jul 29 06:46:36.235882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1045/2058] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:36.681064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:36.682237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:36.688756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:36.689216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:36.689977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:36.690419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:36.692945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:36.829357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:36.837469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d479448-e7ae-43ea-9a45-643f68afa4e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.160000 Jul 29 06:46:36.838031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1014/2059] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:37.258226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:37.258884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:37.266044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:37.266485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:37.267235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:37.267668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:37.333991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:37.343410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:37.344930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:37.346076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-612aa2bb-7ea6-400b-ad6f-c13bdae30024 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091884 Jul 29 06:46:37.346629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1046/2060] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:37.858711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:37.859349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:37.865858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:37.866304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:37.867060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:37.867498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:37.999009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:38.006990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d7028661-9c47-49b0-80df-94d737332dd6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152168 Jul 29 06:46:38.007552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1015/2061] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:38.369621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:38.370233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:38.376664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:38.377114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:38.377868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:38.378299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:38.380832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:38.442899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:38.451805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:38.453325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:38.454559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c670e313-fe99-4ecc-9c7c-b519920996a0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089361 Jul 29 06:46:38.455111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1047/2062] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:39.027915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:39.029340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:39.035876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:39.036327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:39.037124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:39.037557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:39.162275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:39.170428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-33b0b60a-51fc-49db-bcfa-5d7aa4c27526 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146417 Jul 29 06:46:39.170988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1016/2063] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:39.479080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:39.479681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:39.486086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:39.486530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:39.487275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:39.487706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:39.548266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:39.557824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:39.559316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:39.560446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3fc731d8-607a-49f4-82b9-6bf279cc7251 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085763 Jul 29 06:46:39.561025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1048/2064] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:40.191996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:40.192638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:40.199113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:40.199575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:40.200343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:40.200889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:40.330233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:40.339134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-85dbfc8d-9b67-4d16-910a-d336a1f3cd2f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151020 Jul 29 06:46:40.339700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1017/2065] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:40.582981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:40.583591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:40.591137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:40.591609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:40.592390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:40.592855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:40.646669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:46:40.646892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:46:40.653406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:40.661789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:40.663295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:40.664437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c825d05-f9be-4736-9be6-fdb80c7adc33 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085375 Jul 29 06:46:40.665024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1049/2066] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:41.360847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:41.361464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:41.367914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:41.368363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:41.370011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:41.370455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:41.496123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:41.504162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d080c685-e93f-4f1f-a434-d3be28b54c61 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147297 Jul 29 06:46:41.504755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1018/2067] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:41.687013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:41.687541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:41.694027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:41.694508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:41.695267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:41.695700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:41.759827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:41.768313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:41.769841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:41.770972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82e71962-463f-497d-a22f-d862fc98ba1d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087967 Jul 29 06:46:41.771523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1050/2068] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:42.526861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:42.527459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:42.534040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:42.534489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:42.535246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:42.535683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:42.665551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:42.673293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8c8257d0-8840-4be8-b700-8e20c046e094 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151128 Jul 29 06:46:42.673859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1019/2069] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:42.794908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:42.795433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:42.801458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:42.801905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:42.802658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:42.803094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:42.864571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:42.873752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:42.875239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:42.876372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bfed79ba-f5a0-4c40-a2e2-bdf1433cca41 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086141 Jul 29 06:46:42.876952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1051/2070] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:43.694736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:43.695344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:43.702092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:43.702539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:43.703291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:43.703723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:43.831087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:43.839403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8dae2933-225a-4e6f-8902-8f91f66c24cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148802 Jul 29 06:46:43.839963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1020/2071] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:43.899219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:43.900480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:43.907037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:43.907489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:43.908274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:43.908743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:43.970389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:43.979296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:43.980829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:43.981995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fb5e8be6-8d00-4ea3-b730-df4eec4961f0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086672 Jul 29 06:46:43.982540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1052/2072] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:44.860975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:44.861578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:44.868027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:44.869190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:44.869981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:44.870414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:45.000381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:45.005058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:45.005677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:45.008467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-452eb812-7567-404e-8a6e-0486e1ee53e4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151346 Jul 29 06:46:45.009060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1021/2073] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:45.012789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:45.013241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:45.014013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:45.014450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:45.078071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:45.086331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:45.088702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:45.089844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6cb19b93-713a-444f-a412-8745461b3158 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088656 Jul 29 06:46:45.090395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1053/2074] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:46.029697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:46.030274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:46.036841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:46.037304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:46.038070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:46.038516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:46.112437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:46.113078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:46.120952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:46.121405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:46.122170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:46.122602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:46.165685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:46.173678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-195c4b4d-58a6-43ce-9dc3-5cda7557f126 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147879 Jul 29 06:46:46.174246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1022/2075] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:46.187191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:46.195729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:46.198495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:46.199655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4dfba573-f461-4bf2-b70b-02ad7700ded6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091071 Jul 29 06:46:46.200212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1054/2076] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:47.195487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:47.196094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:47.203127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:47.203575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:47.204326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:47.204782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:47.222740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:47.223362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:47.230497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:47.230954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:47.231726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:47.232837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:47.297575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:47.306004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:47.307500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:47.308663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-87051204-8b97-43cf-b94f-d5604f337307 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089784 Jul 29 06:46:47.309207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1055/2077] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:46:47.335281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:47.344042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-df27af12-fe45-4671-9e97-573c1a125299 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152450 Jul 29 06:46:47.344627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1023/2078] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:48.332055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:48.332688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:48.339403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:48.339849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:48.340650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:48.341083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:48.365026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:48.365634 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:48.372942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:48.373390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:48.374149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:48.374585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:48.402461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:48.411008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:48.412492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:48.413642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7b234478-c71d-4fdc-87d8-fe43db8ec8e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085448 Jul 29 06:46:48.414198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1056/2079] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:48.508178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:48.516321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b926779d-3cd9-405b-906b-4246f354d3cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155077 Jul 29 06:46:48.516920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1024/2080] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:46:49.437059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:49.437700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:49.444214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:49.444690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:49.445453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:49.445888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:49.507991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:49.516930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:49.518422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:49.519566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24692268-d191-45e5-bb9d-3473bd022b09 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086457 Jul 29 06:46:49.520115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1057/2081] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:49.538236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:49.538851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:49.546188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:49.546639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:49.547421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:49.547854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:49.674586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:49.682618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e5b176a0-724d-4962-80c7-7ed0a6d19b11 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148203 Jul 29 06:46:49.683179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1025/2082] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:50.544410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:50.545160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:50.551628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:50.552078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:50.552861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:50.553301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:50.617989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:50.626983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:50.628465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:50.629642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-90eb786a-94da-4ddc-a0b9-b7275e780e8c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089653 Jul 29 06:46:50.630193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1058/2083] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:50.704795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:50.705405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:50.711842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:50.712584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:50.713339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:50.713777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:50.844784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:50.852692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b57b81f-f06f-49eb-b745-4a1956fac5ab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151551 Jul 29 06:46:50.853663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1026/2084] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:51.654669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:51.655200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:51.661231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:51.661677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:51.662639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:51.663077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:51.737559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:51.745929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:51.747409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:51.748594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-24075f0c-3705-4eb5-84c5-12b99f70f8aa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.099420 Jul 29 06:46:51.749144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1059/2085] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:51.874829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:51.875460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:51.881927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:51.882388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:51.883171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:51.883611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:52.014378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:52.022279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-43128146-05e8-4649-876b-4fac9357e899 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151299 Jul 29 06:46:52.022848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1027/2086] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:52.771368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:52.771981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:52.779077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:52.779525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:52.780275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:52.780736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:52.843254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:52.851570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:52.853083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:52.854226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fa896a53-b660-4e41-bbe2-119e927d0973 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086715 Jul 29 06:46:52.855468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1060/2087] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:53.043244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:53.043812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:53.050266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:53.050715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:53.051468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:53.051901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:53.179855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:53.187829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e0e2e35d-e3ce-4298-a75a-ee7f9deee2d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148481 Jul 29 06:46:53.188389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1028/2088] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:53.877027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:53.877634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:53.884089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:53.884532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:53.885441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:53.886364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:53.946063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:53.954857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:53.956334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:53.957482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f09193fe-0bc2-4cde-9366-a1c05af48d39 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084407 Jul 29 06:46:53.958026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1061/2089] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:54.209371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:54.210037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:54.217259 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:54.217721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:54.218488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:54.218932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:54.346623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:54.354658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5d6d9665-142b-4cb6-9d6e-a35d787b260e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149088 Jul 29 06:46:54.355244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1029/2090] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:54 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:54.981751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:54.982371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:54.988919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:54.989385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:54.990149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:54.990594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:55.053721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:55.062524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:55.064032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:55.065199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e937ba09-db8d-4496-8dfa-8cd25e5f94e2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088108 Jul 29 06:46:55.065764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1062/2091] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:55.375766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:55.376383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:55.382805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:55.383252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:55.384011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:55.384446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:55.513446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:55.515658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:55.522586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aae44bb0-db0b-4ce0-a58a-660cf9d07d19 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150702 Jul 29 06:46:55.523150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1030/2092] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:56.088178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:56.088814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:56.095831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:56.096279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:56.097061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:56.097489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:56.156563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:56.158671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:46:56.165998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:56.167487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:56.168641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-394922db-620a-4851-98ac-d39bfd007720 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084608 Jul 29 06:46:56.169187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1063/2093] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:56.544285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:56.544846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:56.551336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:56.551784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:56.552550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:56.552989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:56.685559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:56.693388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3934742d-8d3f-413e-808a-31e09023795a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153029 Jul 29 06:46:56.693944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1031/2094] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:57.191273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:57.192251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:57.199442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:57.200005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:57.201001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:57.201434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:57.261883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:57.270393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:57.271881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:57.273046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-94d13241-3832-4da7-9f5f-dd68db721d04 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085922 Jul 29 06:46:57.273603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1064/2095] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:57.714875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:57.715491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:57.721868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:57.722316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:57.723088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:57.723526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:57.851996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:57.859841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-95d51915-e762-4b92-8e51-c27ddbf2085f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149198 Jul 29 06:46:57.860402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1032/2096] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:58.296248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:58.297019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:58.303455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:58.303901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:58.304685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:58.305123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:58.364895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:58.373794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:58.375295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:58.376419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e6bc94fb-19f0-4fa9-a27e-7f708916cf2e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084703 Jul 29 06:46:58.376996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1065/2097] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:46:58.881054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:58.881673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:58.888380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:58.888881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:58.889640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:58.890083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:59.019160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:59.027982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-45214b45-02c6-468a-8d9f-d5c2bf692651 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150603 Jul 29 06:46:59.028567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1033/2098] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:46:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:46:59.399239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:46:59.399844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:46:59.406428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:59.406870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:59.407637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:46:59.408051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:46:59.474412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:59.482871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:59.484368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:46:59.485544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-77824781-d06f-4222-b8ba-e7f695a8960f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090236 Jul 29 06:46:59.486091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1066/2099] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:46:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:00.049689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:00.050232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:00.056814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:00.057274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:00.058548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:00.058986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:00.184568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:00.192424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fdc09779-304e-4c9d-ab62-6794aabdcbc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146660 Jul 29 06:47:00.193015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1034/2100] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:00.508952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:00.509566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:00.516669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:00.517122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:00.517887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:00.518329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:00.584025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:00.593399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:00.594939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:00.596106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3b3ac116-1961-4e72-9b48-1cd12f03174a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091101 Jul 29 06:47:00.596685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1067/2101] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:01.214479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:01.215082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:01.221470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:01.221976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:01.222736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:01.223168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:01.350839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:01.360124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-56443463-279a-40c1-bcae-80ef6c63677a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149932 Jul 29 06:47:01.360712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1035/2102] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:01.618242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:01.618877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:01.625658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:01.626111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:01.626874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:01.627312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:01.687195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:01.695475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:01.696999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:01.698129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fc03e85c-3f4a-42b8-bef1-97b66240fba5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083828 Jul 29 06:47:01.698697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1068/2103] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:02.385309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:02.386981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:02.388831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=52 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:02.394291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:02.394743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:02.395516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:02.395956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:02.528645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:02.536724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ce1aac71-ab30-4433-a675-4c8fb83f58ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155174 Jul 29 06:47:02.537270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1036/2104] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:02.720111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:02.720664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:02.722965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=60 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:02.728233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:02.728714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:02.729978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:02.730424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:02.791604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:02.800129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:02.801653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:02.802787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c52926d0-b1ea-46ee-8f1a-f4bfbf4d59cb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086698 Jul 29 06:47:02.803341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1069/2105] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:03.559092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:03.559705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:03.566381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:03.566836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:03.567596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:03.568036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:03.693340 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:03.701427 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e350516e-2b23-4c1b-b0b9-e186a6f9cd03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147196 Jul 29 06:47:03.701988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1037/2106] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:03.826048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:03.826575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:03.832993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:03.833439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:03.834218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:03.834656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:03.897693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:03.906221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:03.907718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:03.908884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6994bef4-3635-4046-bbb4-df31c02d92e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087417 Jul 29 06:47:03.909436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1070/2107] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:04.722895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:04.723515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:04.730757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:04.731207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:04.731981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:04.732422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:04.860359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:04.868305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-41c255dd-67ae-4df1-af6e-ddf2978e5aab tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149308 Jul 29 06:47:04.868910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1038/2108] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:04.931205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:04.931820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:04.938602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:04.939040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:04.939797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:04.940236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:05.215148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:05.223497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:05.225034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:05.226164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4361a94c-ac3e-43d3-8b17-95af96ceeb1a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.298843 Jul 29 06:47:05.226717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1071/2109] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:05.890016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:05.890625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:05.897127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:05.897573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:05.898328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:05.898764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:06.024222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:06.032671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c6d71542-f8ec-4c27-88f6-fa7b0c3140f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147012 Jul 29 06:47:06.033224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1039/2110] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:06.248884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:06.249492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:06.256651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:06.257100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:06.257856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:06.258323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:06.321007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:06.329903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:06.331405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:06.332570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba3bde0a-6b07-4ea6-a12b-5e75b42b429d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087611 Jul 29 06:47:06.333107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1072/2111] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:07.053840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:07.054385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:07.062082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:07.062538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:07.063309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:07.063748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:07.193821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:07.202390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cbf3a640-116d-4eda-9985-7a4bb395b553 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152525 Jul 29 06:47:07.202952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1040/2112] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:07.355926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:07.356555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:07.363197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:07.363645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:07.364411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:07.364891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:07.425905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:07.434837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:07.436318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:07.437477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d90e7f03-77a9-41ed-a71f-72a12aba67d1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086206 Jul 29 06:47:07.438020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1073/2113] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:08.224631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:08.225247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:08.231996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:08.232457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:08.233263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:08.233709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:08.364578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:08.373124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0b11eb5b-9de0-45cf-9f62-66f19dfa88f1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152363 Jul 29 06:47:08.373685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1041/2114] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:08.460410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:08.461072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:08.467790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:08.468232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:08.469012 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:08.469445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:08.530839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:08.539074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:08.540570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:08.541715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-21d4792f-87da-4114-99d4-ee0f75bdd3ee tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085197 Jul 29 06:47:08.542291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1074/2115] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:09.394733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:09.395348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:09.402146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:09.402689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:09.403462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:09.403901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:09.530592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:09.539001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2ab02c67-faa2-4b07-8596-92307ad74446 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148124 Jul 29 06:47:09.539566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1042/2116] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:09.564766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:09.565368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:09.571839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:09.572287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:09.573069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:09.573541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:09.636171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:09.644636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:09.646213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:09.647290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dd5d3977-c834-4f0b-99ea-c98e63716e5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086437 Jul 29 06:47:09.647845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1075/2117] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:10.561928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:10.562609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:10.569522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:10.569970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:10.570733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:10.571165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:10.669884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:10.670579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:10.677151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:10.677672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:10.678502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:10.679025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:10.702895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:10.710843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d1f43d5-a564-42fd-95c1-0f2b6219fba3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153602 Jul 29 06:47:10.711424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1043/2118] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:10.742313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:10.751462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:10.752980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:10.754102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5aa83faf-5dec-4b0b-83bb-2283c42ce3c0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088302 Jul 29 06:47:10.754656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1076/2119] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:11.420305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:47:11.420576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:47:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:47:11.732825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:11.733361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:11.739934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:11.740395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:11.741199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:11.741641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:11.777902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:11.778516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:11.785486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:11.785943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:11.786723 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:11.787167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:11.851558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:11.860865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:11.862399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:11.863523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-76e74994-26e2-4c86-81cb-13ff3d6acaa2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090107 Jul 29 06:47:11.864070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1077/2120] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:11.871247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:11.879256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7245acc4-efb9-4eb6-959a-c5f75004c207 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151131 Jul 29 06:47:11.879820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1044/2121] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:12.886880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:12.887492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:12.894043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:12.894493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:12.895335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:12.895812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:12.900488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:12.901132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:12.908080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:12.908530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:12.909322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:12.909791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:12.957598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:12.966960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:12.968469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:12.969737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af29aa1c-2f4a-41c4-b7fa-354b6bab1f51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087114 Jul 29 06:47:12.970299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1078/2122] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:13.043264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:13.051105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0f4222fa-4ccc-456c-a0b7-cbb00bbed442 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154522 Jul 29 06:47:13.051663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1045/2123] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:13.993053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:13.993600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:14.000214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:14.000700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:14.001475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:14.001916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:14.065703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:14.071267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:14.071883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:14.074961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:14.076479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:14.077687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a7ce84b-2d05-43e4-9a67-5d8af89a55ff tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088560 Jul 29 06:47:14.078236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1079/2124] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:14.079218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:14.079682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:14.080453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:14.080931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:14.206162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:14.214309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-52fe502c-0b21-44aa-bde9-2f8f5025e4a8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147006 Jul 29 06:47:14.214895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1046/2125] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:15.101625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:15.102276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:15.109013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:15.109465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:15.110226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:15.110692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:15.125957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:15.171481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:15.179818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:15.181379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:15.183208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c6a4b101-3463-43e4-9b88-ce1cfcccab58 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084787 Jul 29 06:47:15.183763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1080/2126] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:15.235463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:15.236066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:15.242547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:15.242991 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:15.243742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:15.244173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:15.259177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:15.371557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:15.379342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-74f50d6e-bfdb-493b-941f-498f5b2082f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147689 Jul 29 06:47:15.379902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1047/2127] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:16.205489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:16.206096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:16.212861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:16.213306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:16.214055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:16.214483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:16.274296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:16.282728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:16.284226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:16.285400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3281d678-38ee-41aa-9443-82ea8dba239a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083791 Jul 29 06:47:16.285962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1081/2128] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:16.400402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:16.401040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:16.407404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:16.407856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:16.408640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:16.409075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:16.538993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:16.547547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-35c5b659-77b4-4a62-ba48-d85070b40ca8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150941 Jul 29 06:47:16.548108 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1048/2129] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:17.309094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:17.309698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:17.316239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:17.316718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:17.317471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:17.317908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:17.378762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:17.387846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:17.389373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:17.390551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ba9a18bd-de17-4ee7-a16a-7a56faa7579e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086081 Jul 29 06:47:17.391043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1082/2130] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:17.569128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:17.569748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:17.577014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:17.577506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:17.578526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:17.579097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:17.705333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:17.713289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-46aedbd5-2eac-4929-a4f8-518e7706121e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148005 Jul 29 06:47:17.713947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1049/2131] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:18.413749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:18.414373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:18.421425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:18.421880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:18.422648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:18.423088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:18.485917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:18.495778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:18.497325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:18.498496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68cd710d-aef4-40b4-ac67-0571464f494f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088707 Jul 29 06:47:18.499064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1083/2132] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:18.734667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:18.735312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:18.741789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:18.742236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:18.742985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:18.743418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:18.875729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:18.883631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3c978775-87d8-4ea4-940b-3e80e82a238f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152799 Jul 29 06:47:18.884217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1050/2133] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:19.520881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:19.521529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:19.528773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:19.529230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:19.529998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:19.530440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:19.591564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:19.599932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:19.601674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:19.602823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a1ec9ad5-e6fd-4be4-9856-93bbfd754354 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085918 Jul 29 06:47:19.603376 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1084/2134] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:19.904706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:19.905327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:19.911935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:19.912391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:19.913206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:19.913648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:20.040458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:20.048495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aaf4ef9a-e9a8-4cf4-97f9-651776e62308 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148185 Jul 29 06:47:20.049089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1051/2135] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:20.626416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:20.627320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:20.638406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:20.638843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:20.639609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:20.640049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:20.703424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:20.711748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:20.713579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:20.714789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d35c5e9-d5ba-41c9-8b3c-76348029d578 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.092492 Jul 29 06:47:20.715351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1085/2136] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:21.069887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:21.072497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:21.079823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:21.080267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:21.081059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:21.081491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:21.221458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:21.230998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a2f13a1a-5f98-4748-bd01-2703a2b0fa06 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.165031 Jul 29 06:47:21.231574 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1052/2137] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:21.738377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:21.738984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:21.745076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:21.745516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:21.746261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:21.746691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:21.806536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:21.816626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:21.818122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:21.819251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e7f283e6-4fc3-4045-a902-a12d8b8b21de tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084927 Jul 29 06:47:21.819788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1086/2138] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:22.252509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:22.253151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:22.259795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:22.260805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:22.261580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:22.262025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:22.391782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:22.399799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eefda0fa-ed02-498e-8919-c61e2add6a33 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151463 Jul 29 06:47:22.400356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1053/2139] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:22.843756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:22.844367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:22.850902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:22.851351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:22.852109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:22.852558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:22.917535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:22.925995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:22.927479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:22.929377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a1122722-b622-44a1-b3ed-e08c7f29a6e3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088848 Jul 29 06:47:22.929377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1087/2140] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:23.421653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:23.422269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:23.428767 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:23.429229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:23.429994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:23.430435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:23.558799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:23.566798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9f2b951b-e71c-40d3-9791-9388feee8b81 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149023 Jul 29 06:47:23.567366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1054/2141] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:23.951777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:23.952395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:23.958879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:23.959336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:23.960099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:23.960560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:24.020785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:24.029912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:24.031398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:24.032527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a50101e9-29e9-49b3-acca-9de68b92c1e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085159 Jul 29 06:47:24.033095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1088/2142] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:24.589551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:24.590172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:24.596274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:24.596772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:24.597561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:24.598010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:24.728467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:24.737418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7dabadbf-21f8-4352-83f9-58aa873e2fb6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152419 Jul 29 06:47:24.737982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1055/2143] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:25.054872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:25.055467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:25.061941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:25.062387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:25.063135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:25.063568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:25.123824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:25.132093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:25.133627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:25.134755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bcacdbd9-0589-453e-b98a-ca603f55d03a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083889 Jul 29 06:47:25.135399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1089/2144] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:25.759178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:25.759787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:25.766694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:25.767145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:25.767903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:25.768341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:25.896117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:25.904781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c9d123a0-ceee-4b18-acb1-484d6d431902 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149403 Jul 29 06:47:25.905377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1056/2145] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:26.157896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:26.158544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:26.169868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.169868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.169868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.169868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.232176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:26.241095 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:26.242592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:26.243750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b57da7c-ccd1-4ec9-be16-f5ca52e24790 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089773 Jul 29 06:47:26.244309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1090/2146] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:26.281513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:26.282265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:26.288559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.289014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.289842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.290366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.315975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:47:26.391540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4c0b5dd5-9161-4fbe-80a2-1687d7b51d35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 204 len: 0 microversion: 2.1 time: 0.113539 Jul 29 06:47:26.392142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1057/2147] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:47:26 2022] DELETE /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:47:26.400971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:26.401904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:26.408141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.408528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.409311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.409743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.537797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:26.545780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac40c22f-1c59-4bcb-9301-fc375900891d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148984 Jul 29 06:47:26.546343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1091/2148] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:26 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:26.927299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:26.927999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:26.934841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.935295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:26.936061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:26.936498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:27.069091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:27.077564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b2298ecb-647f-4131-af91-ff00b1ddd92f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154580 Jul 29 06:47:27.078121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1058/2149] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:27.268739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:27.269287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:27.275834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:27.276595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:27.277362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:27.277802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:27.345668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:27.354115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:27.355618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:27.356793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34b59f36-d1e8-45a7-8029-35ba424bd56b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.092090 Jul 29 06:47:27.357354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1092/2150] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:27.567369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:27.567909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:27.574172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:27.574616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:27.575362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:27.575791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:27.702030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:27.710112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8aed1ad1-5bf3-4daa-8d11-4e2d87204f58 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146638 Jul 29 06:47:27.710689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1059/2151] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:27 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:28.099243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:28.099858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:28.106748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:28.107198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:28.107961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:28.108398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:28.236109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:28.244073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fb42b00d-7033-405d-acb9-d3352c2e1d6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148736 Jul 29 06:47:28.244647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1093/2152] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:28.379377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:28.379997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:28.387499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:28.387950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:28.388762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:28.389202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:28.451426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:28.459756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:28.461293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:28.462721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e79a3a76-1582-41ba-bcdf-2d5385e83737 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087016 Jul 29 06:47:28.463273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1060/2153] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:28.731428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:28.731976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:28.738522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:28.738975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:28.739736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:28.740172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:28.868386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:28.876811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fe4dd49d-1406-4de6-80e4-e60a066990be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149504 Jul 29 06:47:28.877365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1094/2154] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:28 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:29.265569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:29.266191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:29.272285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:29.272774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:29.273538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:29.273978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:29.403170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:29.411066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-65edb08b-208f-43ee-a8c8-6091166d0f99 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149609 Jul 29 06:47:29.411642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1061/2155] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:29.487064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:29.487671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:29.493664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:29.494111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:29.494858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:29.495293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:29.556758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:29.565261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:29.566754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:29.567895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-31577398-74be-4e70-bab3-bb12f5ecaa1b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084750 Jul 29 06:47:29.568450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1095/2156] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:29.898399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:29.899339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:29.906431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:29.906889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:29.907789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:29.908090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:29.927848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:30.040596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:30.048626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-73a8d5f4-41e0-4e7b-a2cf-c7ecef9eeb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154049 Jul 29 06:47:30.049184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1062/2157] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:29 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:30.433398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:30.434013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:30.440435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:30.440890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:30.441644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:30.442075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:30.571904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:30.579849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2a3f990d-8851-4191-94e6-5b68bfcabf50 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150929 Jul 29 06:47:30.580405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1096/2158] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:30.590806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:30.591431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:30.598141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:30.598589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:30.599397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:30.599834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:30.660559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:30.669448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:30.670927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:30.672052 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5f0f5e19-e9b5-4d39-8410-a8c0c21b4479 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085459 Jul 29 06:47:30.672625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1063/2159] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:31.070538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:31.071082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:31.077857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:31.078304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:31.079070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:31.079506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:31.083453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:31.211834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:31.220281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d092f73-031d-42c8-8370-3ca4fc874b77 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153739 Jul 29 06:47:31.220869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1097/2160] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:31 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:31.601416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:31.602031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:31.609331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:31.609784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:31.610543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:31.610982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:31.695206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:31.695814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:31.702548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:31.702997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:31.703754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:31.704186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:31.741698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:31.749874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5a305562-74a5-4406-8595-4351ed4bfda1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152242 Jul 29 06:47:31.750455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1064/2161] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:31.766463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:31.774881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:31.776389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:31.778228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8023bbee-50a7-490b-a9bc-d2cc5d91c351 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086825 Jul 29 06:47:31.778788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1098/2162] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:32.242143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:32.242676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:32.249354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:32.249803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:32.250562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:32.250995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:32.377450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:32.385270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4bf5ad4d-91a9-4b03-9561-269defcb07ad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147259 Jul 29 06:47:32.385928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1065/2163] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:32 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:32.924000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:32.924666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:32.926500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=60 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:32.931754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:32.932206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:32.933058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:32.933479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:32.934478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:32.935132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:32.937028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:32.942462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:32.942922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:32.943694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:32.944133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:33.007378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:33.016679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:33.018199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:33.019367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c5c66d1d-7991-4247-a531-76abef984b5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.221779 Jul 29 06:47:33.019930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1066/2164] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:33.066118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:33.074577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-68faed22-47ce-400b-aeac-fabe7584fa4e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.307292 Jul 29 06:47:33.075139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1099/2165] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:33.407281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:33.407889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:33.413869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:33.414316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:33.415066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:33.415497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:33.544393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:33.552965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-314fed61-bf39-40d1-8a71-fbe1d7d7b17f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149446 Jul 29 06:47:33.553536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1067/2166] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:33 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:34.043641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:34.044221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:34.050796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:34.051251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:34.052017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:34.052469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:34.095624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:34.096235 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:34.102721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:34.103181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:34.103953 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:34.104428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:34.114900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:34.123284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:34.124878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:34.126010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d48c1a21-e2a3-4f4c-b16c-d7820ecb10f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087116 Jul 29 06:47:34.126566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1100/2167] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:34.231063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:34.238977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7ee0901d-b393-4cca-82fb-ab9b13ac8678 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147188 Jul 29 06:47:34.239539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1068/2168] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:34 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:34.574650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:34.575286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:34.581345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:34.581800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:34.582562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:34.583003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:34.709524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:34.717714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a08af6d-7bee-49a0-8591-877187baaae9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147591 Jul 29 06:47:34.718277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1101/2169] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:34 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:35.149459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:35.150162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:35.157218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:35.157672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:35.158426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:35.158864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:35.221372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:35.229725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:35.231233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:35.232402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-20ca26db-19dd-435d-9416-b5f405209ae2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086872 Jul 29 06:47:35.232999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1069/2170] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:35.259537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:35.260156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:35.267584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:35.268044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:35.268830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:35.269585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:35.398583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:35.406638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c17948d6-d997-47d0-a5ae-4c75fb6136d0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150878 Jul 29 06:47:35.407142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1102/2171] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:35.739120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:35.739753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:35.746453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:35.746901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:35.747656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:35.748089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:35.877128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:35.884940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b43a0ff8-96d8-43c8-a67a-b568a9d40134 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149571 Jul 29 06:47:35.885498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1070/2172] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:35 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:36.255315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:36.255951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:36.262652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:36.263219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:36.263824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:36.264254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:36.327307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:36.335658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:36.337198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:36.338589 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d18aadd-8d2a-41a5-9da0-58e1d758854c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087199 Jul 29 06:47:36.339853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1103/2173] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:36.426706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:36.427316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:36.434620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:36.435071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:36.435826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:36.436262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:36.561924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:36.569821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4655a5f3-41c5-41e6-9795-8b94846cf8a4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146953 Jul 29 06:47:36.570387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1071/2174] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:36.908859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:36.909484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:36.915547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:36.915994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:36.916785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:36.917834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:37.045434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:37.053301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b6624815-6a80-4e21-93e5-2f52b71da618 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149652 Jul 29 06:47:37.053864 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1104/2175] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:36 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:37.362216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:37.362823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:37.368790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:37.369242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:37.369992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:37.370559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:37.433753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:37.442106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:37.443591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:37.444755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2effc18a-1368-4a7c-8d18-aa305ecdf1b6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086401 Jul 29 06:47:37.445300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1072/2176] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:37.591771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:37.592416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:37.599473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:37.599917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:37.600732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:37.601165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:37.727374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:37.735497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-78e698d3-ee19-4176-a357-062cb09e3279 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148195 Jul 29 06:47:37.736061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1105/2177] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:38.075062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:38.075639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:38.081691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:38.082142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:38.082899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:38.083336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:38.213321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:38.222158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-845df218-4c6f-4ad6-9acf-32b63dfb8d0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151168 Jul 29 06:47:38.222726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1073/2178] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:38 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:38.469184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:38.469794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:38.475794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:38.476232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:38.477008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:38.477436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:38.541215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:38.550251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:38.552017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:38.553645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-da35b19e-4f7f-440d-b2b7-d5d3dd094cf2 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087950 Jul 29 06:47:38.554196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1106/2179] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:38.757321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:38.757931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:38.765068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:38.765516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:38.766272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:38.766705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:38.894077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:38.903015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8eb9bcb5-d788-4cc3-a2ef-d729c26a2302 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149446 Jul 29 06:47:38.903584 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1074/2180] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:39.243230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:39.243853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:39.250532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:39.250989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:39.251751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:39.252190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:39.380939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:39.389921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a6368b12-fc73-4b6d-8f77-b46e74a91780 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150549 Jul 29 06:47:39.390481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1107/2181] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:39 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:39.575587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:39.576128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:39.582279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:39.582736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:39.583499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:39.583942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:39.647668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:39.656396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:39.657928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:39.659076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe014564-b04a-4991-957f-d35142daaa92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087734 Jul 29 06:47:39.659617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1075/2182] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:39.924010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:39.924820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:39.930885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:39.931330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:39.932079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:39.933038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:40.059152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:40.067233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-57c9371f-de46-4add-87d2-9f5cd8a11b51 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147077 Jul 29 06:47:40.067795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1108/2183] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:40.410996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:40.411618 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:40.419459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:40.419912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:40.420715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:40.421159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:40.547590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:40.555545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-33675fa9-82b4-45ef-b5f2-c5d64260b238 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148351 Jul 29 06:47:40.556109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1076/2184] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:40 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:40.682746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:40.683327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:40.689822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:40.690269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:40.691020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:40.691453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:40.753033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:40.761999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:40.763507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:40.764682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-492c8e16-32a7-4202-97c7-1a944201212e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085984 Jul 29 06:47:40.765373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1109/2185] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:41.090013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:41.090664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:41.096811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:41.097268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:41.098039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:41.098481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:41.224003 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:41.231984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-12f98c06-547e-4d35-8fc5-69e8cdbfca0d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146654 Jul 29 06:47:41.232564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1077/2186] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:41 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:41.577957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:41.578521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:41.584510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:41.584995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:41.585751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:41.586187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:41.715822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:41.724031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d6b5c92-7eaa-41e4-a65c-0b29995a87f8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150676 Jul 29 06:47:41.724612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1110/2187] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:41 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:41.787899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:41.788514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:41.795082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:41.795535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:41.796302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:41.796779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:41.862146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:41.870797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:41.872312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:41.873487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e387960b-e19a-40c0-8254-2bc83f928159 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089513 Jul 29 06:47:41.874050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1078/2188] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:42.252257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:42.252922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:42.258896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:42.259337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:42.260087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:42.261120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:42.386521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:42.394360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9729af89-4ac0-4c5c-90bf-0ab79f1ab6f4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146007 Jul 29 06:47:42.394926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1111/2189] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:42.746416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:42.747040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:42.753113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:42.753565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:42.754359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:42.754799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:42.757379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:42.883542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:42.891687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac14e30a-679c-404b-87f8-0315360a083f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149929 Jul 29 06:47:42.892250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1079/2190] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:42 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:42.896948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:42.897663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:42.904934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:42.905407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:42.906148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:42.906588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:42.969034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:42.977374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:42.978892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:42.980695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-97ce6083-8f0e-40f9-aade-07655243e9e9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087725 Jul 29 06:47:42.981263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1112/2191] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:43.415370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:43.415980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:43.422206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:43.422652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:43.423403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:43.423836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:43.549077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:43.556898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-38bea222-09c5-432d-8c8a-3c0b8145d375 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.145339 Jul 29 06:47:43.558010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1080/2192] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:43.913366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:43.914452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:43.921280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:43.921734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:43.922493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:43.922929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:44.003512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:44.004013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:44.010499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:44.010947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:44.011712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:44.012230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:44.051974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:44.054248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:44.062179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e129a07c-dbef-48ec-ab8c-08be90ee79db tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152678 Jul 29 06:47:44.062753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1113/2193] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:43 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:44.077659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:44.086282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:44.088035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:44.089337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-347af124-ad69-43b3-ba6e-67d750a551bf tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089868 Jul 29 06:47:44.089886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1081/2194] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:44.579225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:44.579827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:44.585815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:44.586263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:44.587014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:44.587711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:44.712705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:44.721394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-572d5cc0-cd49-40ce-ba7f-d0c95231c6a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146186 Jul 29 06:47:44.721958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1114/2195] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:45.083306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:45.083951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:45.090951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:45.091400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:45.092153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:45.092614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:45.112400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:45.113052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:45.119477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:45.120447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:45.121253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:45.121692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:45.183572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:45.192138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:45.193676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:45.194850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a5eb2bf-8677-4099-8c88-789563a40fa9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086335 Jul 29 06:47:45.195410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1115/2196] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:45 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:45.220808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:45.228628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-70348365-4ea8-421c-81b3-01250188625d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149120 Jul 29 06:47:45.229296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1082/2197] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:45 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:45.742793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:45.743403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:45.750538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:45.750989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:45.751749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:45.752185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:45.883882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:45.892562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b2040a3e-eb5e-4ec4-8078-189ce146db42 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153558 Jul 29 06:47:45.893130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1116/2198] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:46.218231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:46.218847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:46.225264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:46.225708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:46.226456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:46.226886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:46.250917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:46.251525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:46.258037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:46.258481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:46.259238 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:46.259668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:46.288070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:46.297311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:46.298803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:46.299941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a2180569-26d6-4812-a831-90372e5a4216 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085599 Jul 29 06:47:46.300711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1083/2199] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:46.387210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:46.395020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9f1659c2-b0d7-4f66-9f8f-29c5c84094ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148231 Jul 29 06:47:46.395579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1117/2200] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:46 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:46.913989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:46.914603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:46.922149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:46.922610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:46.923384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:46.923857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:47.051781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:47.059717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0ad75956-876c-43f9-bf88-28d52a32db93 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149554 Jul 29 06:47:47.060287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1084/2201] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:47.323754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:47.324438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:47.330955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:47.331400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:47.332148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:47.332602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:47.397476 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:47.405942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:47.407424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:47.408570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e2221718-7a73-4d37-a999-ff657b0b4c68 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089407 Jul 29 06:47:47.409122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1118/2202] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:47.417894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:47.418501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:47.424912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:47.425362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:47.426113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:47.426572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:47.552875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:47.561661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d4096de9-8e05-4194-9104-a7bd8f0d0e28 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147895 Jul 29 06:47:47.562727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1085/2203] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:47 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:48.081188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:48.081735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:48.087920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:48.088368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:48.089768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:48.090209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:48.218581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:48.226459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a51b7c21-a182-407d-8ec5-d66ef89b4801 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149489 Jul 29 06:47:48.227009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1119/2204] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:48.431013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:48.431622 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:48.438104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:48.438550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:48.439305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:48.439739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:48.503015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:48.512197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:48.513747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:48.514887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7dc645df-fcb9-4445-b2cb-3df61a74b10c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087843 Jul 29 06:47:48.515445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1086/2205] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:48.584763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:48.585379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:48.592813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:48.593268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:48.594036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:48.594514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:48.719793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:48.728195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1425a2df-5475-4265-911a-f75f99b226e6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147279 Jul 29 06:47:48.728790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1120/2206] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:48 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:49.248874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:49.249603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:49.255585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:49.256034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:49.256811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:49.257244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:49.388068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:49.395978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-40d3cf8c-699f-4ec3-bcc6-1acd323584ae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151599 Jul 29 06:47:49.396566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1087/2207] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:49.537612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:49.538164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:49.544679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:49.545134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:49.545919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:49.546358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:49.612452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:49.621754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:49.623336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:49.624510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-044e7f94-6a33-49c4-a7fb-2b29c1566d6e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090912 Jul 29 06:47:49.625094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1121/2208] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:49.750371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:49.750987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:49.757528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:49.757978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:49.758732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:49.759168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:49.899443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:49.907729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3c68cfb3-c6ff-47c1-b0f2-319678248977 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.162117 Jul 29 06:47:49.908307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1088/2209] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:49 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:50.418813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:50.419427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:50.425719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:50.426177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:50.426948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:50.427392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:50.553361 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:50.561445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f764e1e5-e5fd-4549-ab81-6ca265d05235 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147074 Jul 29 06:47:50.562006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1122/2210] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:50.647178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:50.647787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:50.654743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:50.655178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:50.655938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:50.656371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:50.717505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:50.726086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:50.727892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:50.729435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-573e98a3-93e0-46b8-b0e6-feb00802fc37 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085775 Jul 29 06:47:50.729996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1089/2211] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:50.929684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:50.930297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:50.936523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:50.937011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:50.937771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:50.938209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:51.063989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:51.071844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0e0e80c6-1269-4b81-9919-c4a83e6d55d9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146024 Jul 29 06:47:51.072401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1123/2212] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:50 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:51.583031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:51.583642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:51.591074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:51.591518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:51.592269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:51.592737 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:51.721505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:51.729580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e35cd393-e711-4f92-a901-5288441dd5c0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150577 Jul 29 06:47:51.730347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1090/2213] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:51.752370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:51.753020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:51.759031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:51.759481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:51.760236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:51.760710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:51.825082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:51.833563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:51.835056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:51.836195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7f22cb81-7258-4f7c-8cc4-a78a2d15ba91 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087656 Jul 29 06:47:51.836786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1124/2214] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:52.093943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:52.094616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:52.100757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:52.101210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:52.101975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:52.102442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:52.238398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:52.247074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b9e319ca-1307-4c7e-abac-427d2fff893e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156981 Jul 29 06:47:52.247647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1091/2215] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:52 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:52.751016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:52.751630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:52.758224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:52.758678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:52.759435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:52.759870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:52.859826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:52.860434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:52.866808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:52.867265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:52.868024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:52.868463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:52.892123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:52.900184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dfcd9316-589c-4412-8e0e-354931dda661 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153007 Jul 29 06:47:52.900787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1125/2216] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:52.929933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:52.938445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:52.939940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:52.941110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d8f5f284-81f7-4e35-be99-a6591a4c3e6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085251 Jul 29 06:47:52.941688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1092/2217] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:53.268403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:53.269066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:53.275302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:53.275750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:53.277380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:53.277857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:53.405440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:53.413218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-db4821af-d478-47e1-9225-201a415bc2ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148688 Jul 29 06:47:53.413774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1126/2218] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:53 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:53.922619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:53.923129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:53.929184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:53.929637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:53.930391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:53.930829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:53.965537 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:53.966155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:53.972778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:53.973234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:53.974010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:53.974452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:54.039663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:54.048578 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:54.050115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:54.051271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ed329275-ab37-4ca1-a104-678b4ad524ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090833 Jul 29 06:47:54.051831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1127/2219] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:47:54.063220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:54.071141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-92b9c667-53d1-403c-8541-1a3de846df2e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153149 Jul 29 06:47:54.071703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1093/2220] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:54.434087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:54.434695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:54.440666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:54.441115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:54.441878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:54.442292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:54.571514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:54.579783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-494e6053-b58a-41ab-bdaa-4154fec81346 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150273 Jul 29 06:47:54.580356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1128/2221] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:54 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:55.075451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:55.075989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:55.082477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:55.082928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:55.083683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:55.084120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:55.093278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:55.093900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:55.099822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:55.100275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:55.101094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:55.101525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:55.147330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:55.156090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:55.157601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:55.158735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-de4a2f65-50f8-4152-933c-ab68db7373e8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088080 Jul 29 06:47:55.159297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1094/2222] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:55.231593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:55.239440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af7b3fe6-20b8-4f21-a932-3cfa27b19ae3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150598 Jul 29 06:47:55.239989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1129/2223] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:55.601413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:55.602024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:55.608635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:55.609085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:55.609835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:55.610267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:55.739554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:55.741780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:55.748896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d324b5fa-80ac-4afe-aca2-362568629d04 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151295 Jul 29 06:47:55.749455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1095/2224] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:55 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:56.181731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:56.182343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:56.189129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:56.189577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:56.190341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:56.190780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:56.205926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:47:56.252379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:56.261353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:56.262850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:56.262988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:56.263485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:56.263988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5376826b-4db4-4033-816a-d0aa25161434 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086140 Jul 29 06:47:56.264575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1130/2225] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:56 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:56.270215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:56.270669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:56.271437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:56.271880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:56.398874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:56.406801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-274c19ab-06ac-47df-a4bb-0407ccbf36de tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149045 Jul 29 06:47:56.407359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1096/2226] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:47:56.770432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:56.771072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:56.777934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:56.778378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:56.779137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:56.779570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:56.904709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:56.912515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ae891785-1774-4262-bf5f-d06c995229aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146345 Jul 29 06:47:56.913089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1131/2227] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:56 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:57.287113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:57.287721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:57.294184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:57.294630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:57.295385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:57.295821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:57.358464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:57.367037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:57.368559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:57.369839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ea66d83f-0a75-45ca-9e0a-9c7b4911a5cc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086614 Jul 29 06:47:57.371377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1097/2228] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:57.427223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:57.427836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:57.435138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:57.435583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:57.436380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:57.436857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:57.566374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:57.574189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f71284a7-3a64-4978-b644-44b580c19cf7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150857 Jul 29 06:47:57.574745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1132/2229] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:57.937499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:57.938124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:57.944128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:57.944608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:57.945369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:57.945803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:58.072135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:58.080017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cbd9147d-7a38-412b-8b66-e8b3a45d4e22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149647 Jul 29 06:47:58.080593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1098/2230] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:57 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:58.393009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:58.393621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:58.399845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:58.400290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:58.401078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:58.402103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:58.465909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:58.474306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:58.475796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:58.476963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ada60521-be4e-4a8c-85fa-1451b11579f3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087864 Jul 29 06:47:58.477535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1133/2231] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:58.595932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:58.596562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:58.602983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:58.603466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:58.604278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:58.604855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:58.736950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:58.744992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ac3da98a-f0d7-45e1-891f-865a0ec0fca4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152862 Jul 29 06:47:58.746093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1099/2232] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:59.102063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:59.102676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:59.108802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:59.109248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:59.109997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:59.110430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:59.236430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:59.244411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1fdfd3f-7ab5-47d2-aeb0-f5ffd27a98f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146518 Jul 29 06:47:59.245022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1134/2233] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:59 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:47:59.500798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:59.501355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:59.507448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:59.507901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:59.508686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:59.509123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:59.569579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:59.579157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:59.580693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:59.581848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7ccdfa1-1c0b-4a0b-a355-ccfac057b290 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085069 Jul 29 06:47:59.582430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1100/2234] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:47:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:47:59.766976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:47:59.767519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:47:59.774027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:59.774478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:59.775225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:47:59.775659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:47:59.904937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:47:59.912813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-10c9da14-e5cf-43c0-a37b-9d499b1de76f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149686 Jul 29 06:47:59.913568 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1135/2235] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:47:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:00.325613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:00.326198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:00.332654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:00.333104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:00.333853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:00.334283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:00.465721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:00.473566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b46497cb-ffb4-46b0-8a1a-873be5025051 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152417 Jul 29 06:48:00.474122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1101/2236] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:00 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:00.604926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:00.605555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:00.611609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:00.612064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:00.612898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:00.613340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:00.673215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:00.681541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:00.683194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:00.684336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-09da6cab-32bd-4e94-b6a6-4b83fec4e13a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083678 Jul 29 06:48:00.684922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1136/2237] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:00.934632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:00.935168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:00.941376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:00.941831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:00.942586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:00.943025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:01.068820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:01.077257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-51ff95b0-c008-44ec-9411-9f7fda81996b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147299 Jul 29 06:48:01.077824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1102/2238] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:01.494741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:01.496134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:01.502379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:01.502820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:01.503567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:01.503999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:01.630872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:01.638908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-17cb5765-5e1e-4973-bf61-2d09a1c5f2a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148027 Jul 29 06:48:01.639584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1137/2239] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:01 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:01.707427 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:01.708065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:01.715299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:01.715756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:01.716580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:01.717017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:01.778772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:01.787084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:01.788600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:01.789761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-96e216d0-b672-4112-bc50-50d7a02e39b3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086295 Jul 29 06:48:01.790296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1103/2240] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:02.098927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:02.099546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:02.106206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:02.106668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:02.107406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:02.107839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:02.235088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:02.242912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-533df196-a705-4d31-95e5-b1d8d217c9aa tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147873 Jul 29 06:48:02.243468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1138/2241] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:02.660078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:02.660718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:02.666781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:02.667315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:02.668068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:02.668498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:02.807861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:02.813728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:02.814469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:02.817732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5c4c6d19-9978-4c6a-a55f-f15b7da5b46b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.161376 Jul 29 06:48:02.818499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1104/2242] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:02 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:02.821218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:02.821742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:02.822610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:02.824330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:02.889246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:02.897715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:02.899223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:02.900357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6130d63d-096d-47e7-83fd-82fa03f08011 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090637 Jul 29 06:48:02.900996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1139/2243] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:03.264895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:03.265505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:03.267363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=78 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:03.272690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:03.273141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:03.273900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:03.274334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:03.399783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:03.408255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7ad985d-2473-4c14-ada5-4fa2c190ee47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147530 Jul 29 06:48:03.408838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1105/2244] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:03.840590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:03.841199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:03.843478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=82 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:03.848895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:03.849346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:03.850096 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:03.850528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:03.924080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:03.924789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:03.931411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:03.931868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:03.932840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:03.933285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:03.978693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:03.987766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a61df78c-611c-424b-a249-f6d0fdb6a87a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151859 Jul 29 06:48:03.988274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1140/2245] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:03 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:03.995188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:04.003578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:04.005087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:04.006217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-95636b5c-95c5-4f7f-8af2-78f81d986c4b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086313 Jul 29 06:48:04.006754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1106/2246] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:04.429342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:04.429956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:04.436422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:04.436916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:04.437670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:04.438104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:04.568838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:04.577409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-42bb1b49-0c96-46ee-a056-96e31834b6ca tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151910 Jul 29 06:48:04.577972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1141/2247] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:05.008761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:05.009401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:05.016171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:05.016655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:05.017416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:05.017852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:05.028569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:05.029172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:05.035284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:05.035731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:05.036488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:05.036943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:05.098969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:05.107708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:05.109258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:05.110416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-719d7706-f8fd-488b-a82e-2a325e9ab3a4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085715 Jul 29 06:48:05.110973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1142/2248] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:05.149972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:05.157985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fde6b768-d796-49d6-909b-41bd842b238a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153198 Jul 29 06:48:05.158549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1107/2249] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:05 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:05.599859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:05.600473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:05.606687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:05.607141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:05.607904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:05.608348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:05.739086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:05.747748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f1457411-55a7-42f8-b024-12f0e412ee97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151694 Jul 29 06:48:05.748314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1143/2250] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:06.133303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:06.133909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:06.140420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:06.140897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:06.141650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:06.142084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:06.179045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:06.179580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:06.186223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:06.186671 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:06.187437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:06.187859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:06.202345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:06.210709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:06.212206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:06.214141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cc9cab36-19ab-4fdb-b1dd-51fabfbdca64 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084266 Jul 29 06:48:06.214787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1108/2251] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:06 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:06.315265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:06.323307 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-66ee70a3-dba9-4b91-9386-09f5d11bb785 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147953 Jul 29 06:48:06.323898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1144/2252] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:06 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:06.770208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:06.770814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:06.777552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:06.777998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:06.778751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:06.779185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:06.910377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:06.918346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b8244d44-3b75-4bd0-820b-7e6aca3cbe25 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151954 Jul 29 06:48:06.918910 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1109/2253] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:07.237393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:07.238007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:07.244714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:07.246054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:07.246397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:07.246840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:07.306693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:07.316180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:07.317728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:07.318870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c14b3492-f63d-462a-9886-3df992e82c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085358 Jul 29 06:48:07.319432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1145/2254] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:07.343391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:07.344001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:07.350551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:07.350988 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:07.351739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:07.352173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:07.479446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:07.487306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-01ab6cc0-c5dc-4cb9-8b9f-7b1859008420 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147782 Jul 29 06:48:07.487908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1110/2255] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:07 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:07.941076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:07.941678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:07.947718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:07.948265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:07.949069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:07.949503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:08.077136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:08.084919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f9318cbf-c8e1-4771-a8d3-09cca4be9ecd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147664 Jul 29 06:48:08.085477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1146/2256] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:08.342648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:08.343287 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:08.349637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:08.350205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:08.350833 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:08.351265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:08.411942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:08.421130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:08.422668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:08.423804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-28c6c7dd-f380-44d8-ac0e-cc5003277568 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085640 Jul 29 06:48:08.424354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1111/2257] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:08.508823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:08.509431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:08.515855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:08.516297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:08.517079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:08.517510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:08.520000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:08.645944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:08.654436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6cd2dcb2-24c4-4721-a936-6e9153f7ef26 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149482 Jul 29 06:48:08.654993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1147/2258] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:08 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:09.107727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:09.108341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:09.114423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:09.114876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:09.115669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:09.116111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:09.131113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:09.247488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:09.255336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3526ad99-2329-4e88-b06b-afbcca007343 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151803 Jul 29 06:48:09.255897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1112/2259] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:09.449624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:09.450163 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:09.456243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:09.456742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:09.457511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:09.457950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:09.518738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:09.527774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:09.529302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:09.530447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f6bd43c0-08fe-4d87-bb38-f2d9fc061452 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085494 Jul 29 06:48:09.531006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1148/2260] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:09.675158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:09.675753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:09.682296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:09.683006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:09.683853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:09.684293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:09.810789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:09.818635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e2e33b06-f920-4eb6-92e3-45240af1d319 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147288 Jul 29 06:48:09.819205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1113/2261] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:10.278633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:10.279244 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:10.285450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:10.285896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:10.286649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:10.287091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:10.418316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:10.426291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c4156853-c649-4ebe-aaa0-435ea5cf79cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152342 Jul 29 06:48:10.426845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1149/2262] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:10.553432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:10.554063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:10.560175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:10.560667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:10.561410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:10.561841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:10.622560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:10.630919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:10.632419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:10.633583 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a2cbf07d-83f1-405c-8b85-5bfbca750ae0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084877 Jul 29 06:48:10.634138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1114/2263] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:10.840378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:10.841028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:10.847984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:10.848433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:10.849219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:10.849656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:10.977106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:10.984931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-abd7f0e3-840c-4c85-b1be-e01c254dccd7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149276 Jul 29 06:48:10.985490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1150/2264] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:11.448841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:11.449517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:11.455965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:11.456408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:11.457196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:11.457627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:11.586757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:11.595215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2a9b692e-3052-4671-a97c-cdce89bf0098 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150873 Jul 29 06:48:11.595775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1115/2265] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:11.656456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:11.657085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:11.663053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:11.663497 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:11.664248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:11.664708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:11.724660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:11.733960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:11.735452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:11.736609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b6f5871-e2d6-4796-abde-6c152cdab4f8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083979 Jul 29 06:48:11.737164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1151/2266] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:12.006088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:12.006647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:12.013202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:12.013660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:12.014417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:12.014858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:12.143598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:12.152148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-622a4f33-f2b2-4e23-82f1-0a0725a37325 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149934 Jul 29 06:48:12.152739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1116/2267] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:12 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:12.616627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:12.617224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:12.624120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:12.624605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:12.625375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:12.625814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:12.757744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:12.759348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:12.759969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:12.766969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-187cb981-1124-40c3-bd53-479671af9be1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154228 Jul 29 06:48:12.767207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:12.767769 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1152/2268] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:12.767895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:12.768490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:12.768963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:12.830508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:12.839687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:12.841238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:12.842366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4f1812b6-79a6-4e81-bc08-40cdf9befd35 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087017 Jul 29 06:48:12.842928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1117/2269] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:13.173828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:13.174444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:13.180743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:13.181194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:13.181948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:13.183032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:13.310210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:13.318161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af8ca08f-25ca-4d19-8fd7-29ce1a842e2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148193 Jul 29 06:48:13.318728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1153/2270] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:13 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:13.788921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:13.789531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:13.796973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:13.797424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:13.798183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:13.798621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:13.866294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:13.866923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:13.873980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:13.874425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:13.875185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:13.875614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:13.930241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:13.937927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:13.938477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d57b2a87-6d8c-40bd-b8f8-cb2265ff933e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153335 Jul 29 06:48:13.939053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1118/2271] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:13.946407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:13.948472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:13.949711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f45e0354-c2b0-431a-a701-196ae38f6f5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087339 Jul 29 06:48:13.950249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1154/2272] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:14.340012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:14.340674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:14.346705 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:14.347156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:14.347907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:14.348343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:14.475216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:14.483698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-719669ac-bb15-48ae-866e-b743b27bc018 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148307 Jul 29 06:48:14.484268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1119/2273] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:14 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:14.960963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:14.961599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:14.969560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:14.970011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:14.970779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:14.971248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:14.972488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:14.973143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:14.979701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:14.980250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:14.981045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:14.981492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:15.043010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:15.051448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:15.052981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:15.054135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d30efee2-b952-4c7b-9fee-ea3fe0e90015 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085480 Jul 29 06:48:15.054700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1120/2274] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:15.102034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:15.110749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c43f33be-a1c0-4388-acb3-5e3e7870afd0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153588 Jul 29 06:48:15.111301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1155/2275] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:15.505186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:15.505796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:15.512250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:15.512722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:15.513471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:15.513934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:15.644979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:15.653199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-de9edd81-e87c-4ef6-9ae9-153900d4e5a5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151855 Jul 29 06:48:15.653764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1121/2276] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:15 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:16.077788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:16.078402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:16.084862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:16.085570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:16.086333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:16.086765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:16.132361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:16.133004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:16.140187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:16.140676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:16.141450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:16.141894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:16.149935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:16.158935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:16.160419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:16.161581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-226f45f8-b5da-4ce2-a5b9-64a21536f375 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087841 Jul 29 06:48:16.162128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1156/2277] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:16 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:16.267663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:16.275514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-14547137-9cda-4f1e-b288-a14c3130dc02 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147084 Jul 29 06:48:16.276718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1122/2278] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:16.674029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:16.674647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:16.680824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:16.681283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:16.682052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:16.682734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:16.811045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:16.819725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e6c03128-1ced-43f2-9f89-ad9c2ba34114 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149533 Jul 29 06:48:16.820291 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1157/2279] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:17.186093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:17.186710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:17.193308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:17.193761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:17.194527 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:17.194967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:17.259628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:17.268890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:17.270431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:17.271570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-800f0789-d78c-49f3-bdfc-672868b38e5e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090676 Jul 29 06:48:17.272156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1123/2280] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:17.297567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:17.298588 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:17.305029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:17.305480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:17.306232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:17.306666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:17.435175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:17.443148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-19fa355c-d53a-41cf-b903-988229133ca1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149543 Jul 29 06:48:17.443649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1158/2281] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:17.840501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:17.841130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:17.847137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:17.847581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:17.848332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:17.848787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:17.976804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:17.985539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca7a630c-117d-46c4-8291-e6427bddd625 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149257 Jul 29 06:48:17.986039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1124/2282] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:17 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:18.294180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:18.294738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:18.301533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:18.302094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:18.302737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:18.303177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:18.364473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:18.373091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:18.374592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:18.375731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cd06a26a-d806-4a79-bbcd-8a1630e16de4 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085568 Jul 29 06:48:18.376295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1159/2283] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:18.466130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:18.467888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:18.474451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:18.474909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:18.475678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:18.476119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:18.605571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:18.613582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d4f5ebbe-0f29-47ce-ab66-3496dea1531e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152198 Jul 29 06:48:18.614156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1125/2284] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:19.007692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:19.008301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:19.014873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:19.015323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:19.016079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:19.016518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:19.147472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:19.156119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c049af0c-3e0a-4195-af44-55795cca166e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152266 Jul 29 06:48:19.156728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1160/2285] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:19 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:19.398427 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:19.399041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:19.405169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:19.405627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:19.406418 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:19.406862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:19.472390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:19.482172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:19.483676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:19.484825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bde1653a-0274-4298-906b-c2a4f7b36bfc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090338 Jul 29 06:48:19.485390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1126/2286] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:19.635300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:19.636128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:19.642821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:19.643271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:19.644038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:19.644477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:19.770340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:19.778831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2d191580-f7d6-44b3-add0-945375efb497 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147379 Jul 29 06:48:19.779389 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1161/2287] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:20.177215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:20.177843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:20.183885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:20.184334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:20.185128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:20.185572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:20.311443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:20.319351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6380b8bb-1e3b-4d08-912c-9c4b431dbf1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146032 Jul 29 06:48:20.319917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1127/2288] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:20 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:20.508570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:20.509114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:20.515634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:20.516084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:20.516873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:20.517309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:20.577835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:20.586117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:20.587878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:20.589550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-20cb7a2c-2e3c-4c55-b358-e9a51391cdc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084994 Jul 29 06:48:20.590097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1162/2289] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:20.800590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:20.801151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:20.807708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:20.808162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:20.808981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:20.809422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:20.941383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:20.949929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-224c9d11-0423-402e-b8cc-927ad70e1e14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153302 Jul 29 06:48:20.950482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1128/2290] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:21.341782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:21.342672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:21.352384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:21.352871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:21.353640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:21.354085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:21.490492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:21.492678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:21.499987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-46efd6e6-088b-405d-be1b-cac9a8ee7d2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.163208 Jul 29 06:48:21.500585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1163/2291] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:21 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:21.612946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:21.613561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:21.622613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:21.623445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:21.624224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:21.624707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:21.628611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:21.702289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:21.710853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:21.712354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:21.713863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a1fb2863-4f04-439f-bccc-ecfa7c09f35a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.104862 Jul 29 06:48:21.714421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1129/2292] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:21.972894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:21.973446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:21.979517 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:21.980033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:21.980825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:21.981272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:22.108130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:22.116069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-535fdb8f-b61f-4ae5-8ca0-1c28613bb920 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147335 Jul 29 06:48:22.116774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1164/2293] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:22.525665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:22.527033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:22.533502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:22.533970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:22.534724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:22.535155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:22.667794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:22.675658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-199ed933-2ccd-49b6-88da-816a068ba086 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153894 Jul 29 06:48:22.676218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1130/2294] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:22 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:22.746442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:22.747092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:22.753691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:22.754145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:22.754909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:22.755351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:22.816718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:22.825351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:22.826859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:22.828034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f766d781-5a16-4a33-b34d-21a265772739 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085564 Jul 29 06:48:22.828607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1165/2295] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:23.138723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:23.139343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:23.145581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:23.146036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:23.146802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:23.147264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:23.271950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:23.280077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2a350cf5-fb52-44ec-ae53-29c7d27aee03 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.145878 Jul 29 06:48:23.280666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1131/2296] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:23.696950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:23.697571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:23.703599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:23.704045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:23.704825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:23.705263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:23.834914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:23.843969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c9574ae3-638d-4633-98e9-a0afbe3bf60c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150864 Jul 29 06:48:23.844559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1166/2297] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:23 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:23.851465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:23.852075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:23.858435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:23.858888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:23.859643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:23.860082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:23.923253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:23.931657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:23.933783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:23.934518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6464bdef-59db-4a4a-9806-d8c1d953910b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087278 Jul 29 06:48:23.935072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1132/2298] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:24.301607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:24.302223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:24.308208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:24.308684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:24.309446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:24.309883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:24.438070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:24.446424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d14f04ff-cb38-4b01-9c9e-ca3a4ff0d27b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148636 Jul 29 06:48:24.446984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1167/2299] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:24.865829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:24.866448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:24.874075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:24.874556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:24.875346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:24.875794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:24.958084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:24.958693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:24.965562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:24.966007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:24.966766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:24.967200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:25.006304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:25.015476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2ba5662b-1905-45cd-a81e-dd486036f2f3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153499 Jul 29 06:48:25.016179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1133/2300] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:24 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:25.029025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:25.037341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:25.038831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:25.039954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-79c292e2-9aa4-4a97-81b0-e5ae3f89ad55 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085784 Jul 29 06:48:25.040507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1168/2301] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:25.468373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:25.469022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:25.475056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:25.475511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:25.476268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:25.476758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:25.603130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:25.611496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1a621e08-48ea-46e0-afe1-0a88f9a3accc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146971 Jul 29 06:48:25.612066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1134/2302] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:26.063094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:26.063712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:26.070051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:26.070506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:26.071268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:26.071706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:26.137571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:26.146047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:26.147619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:26.148786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b1d5614-58dd-4cdc-804b-212fe2778efb tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089602 Jul 29 06:48:26.149345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1135/2303] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:26 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:26.155700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:26.156487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:26.162617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:26.163138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:26.163963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:26.164408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:26.294979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:26.302911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-291084d1-7b5f-42dc-a1ad-e5f2618fb1a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.269545 Jul 29 06:48:26.303475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1169/2304] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:26 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:26.632912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:26.633525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:26.640816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:26.641269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:26.642029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:26.642464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:27.015927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:27.023839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1a7984eb-460e-410b-b7c5-fedcdb6901df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.394726 Jul 29 06:48:27.024407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1136/2305] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:27.171753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:27.172367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:27.178967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:27.179416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:27.180164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:27.180622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:27.241191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:27.250424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:27.251913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:27.253083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-15f81ffb-67d3-4f51-be87-1c6dc532ef5d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085197 Jul 29 06:48:27.253631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1170/2306] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:27 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:27.324059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:27.324694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:27.331163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:27.331608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:27.332355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:27.332810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:27.459270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:27.468179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4ff9f1e3-579a-4f28-8dc2-56cac24cc4e7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147880 Jul 29 06:48:27.468774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1137/2307] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:27 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:28.046079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:28.046611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:28.052593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:28.053039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:28.053791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:28.054223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:28.185848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:28.193714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a5eccee9-6f3c-4d9e-9847-3dcb3698b7ee tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151609 Jul 29 06:48:28.194271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1171/2308] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:28.275802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:28.276667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:28.282640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:28.283084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:28.283829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:28.284260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:28.346868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:28.355925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:28.357448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:28.358581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-371fafe1-c423-4564-95f0-4d3df69febdc tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086723 Jul 29 06:48:28.359132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1138/2309] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:28 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:28.489107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:28.489747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:28.497329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:28.497853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:28.498755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:28.499195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:28.630174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:28.638121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-172703af-f6a4-4d31-b349-c87e3a4bd840 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152869 Jul 29 06:48:28.638680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1172/2310] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:28 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:29.216005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:29.216648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:29.222680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:29.223129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:29.223886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:29.224352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:29.348958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:29.357071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-430054be-e551-4451-97d4-88662a62f05d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146168 Jul 29 06:48:29.357632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1139/2311] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:29.381609 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:29.382525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:29.389796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:29.390245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:29.391070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:29.391511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:29.460721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:29.469529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:29.470948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:29.472078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8b3a81f-4d88-4f25-97e2-e8e6000a1af7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.094298 Jul 29 06:48:29.472656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1173/2312] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:29 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:29.659619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:29.660233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:29.666836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:29.667657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:29.669032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:29.669826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:29.801069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:29.809804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-23fe24fa-07c8-42ab-b6b5-f3776177c0d8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153999 Jul 29 06:48:29.810376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1140/2313] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:29 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:30.378956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:30.379562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:30.386624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:30.387187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:30.387807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:30.388240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:30.495277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:30.495908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:30.502436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:30.502957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:30.503732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:30.504172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:30.515502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:30.523449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-20a52d94-d33c-4cec-9990-5454c03f3c5b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148341 Jul 29 06:48:30.524008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1174/2314] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:30.565766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:30.574104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:30.575613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:30.576779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c3a077bd-12c0-4026-a1d5-868cc28f887e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086243 Jul 29 06:48:30.577344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1141/2315] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:30 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:30.831382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:30.832263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:30.839128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:30.839580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:30.840347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:30.840810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:30.966944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:30.974992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c9331ab-0028-4cb7-b17e-5a5d8dc9f590 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147424 Jul 29 06:48:30.975552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1175/2316] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:30 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:31.544894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:31.545460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:31.551942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:31.552395 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:31.553211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:31.553652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:31.599179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:31.599790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:31.606304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:31.606761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:31.607524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:31.607964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:31.670029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:31.678535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:31.680048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:31.681243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-af245a92-e4ea-4d35-b1ec-f4040d3d5ee1 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085919 Jul 29 06:48:31.682542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1176/2317] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:31 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:31.683966 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:31.691901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b0369ec-59dc-4575-a4ea-bb1e174a86ed tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151058 Jul 29 06:48:31.692452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1142/2318] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:31.997425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:31.998035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:32.004049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:32.004491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:32.005271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:32.005701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:32.134353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:32.143187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1bbe0933-5c37-4414-a195-14d051624d33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149725 Jul 29 06:48:32.143743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1177/2319] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:31 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:32.704596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:32.705214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:32.711791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:32.712247 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:32.712394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:32.713305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:32.713748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:32.713908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:32.720645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:32.721094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:32.721865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:32.722304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:32.778021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:32.786630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:32.788207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:32.789381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b7aec35-9935-41d3-8437-8d9f68993a92 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088703 Jul 29 06:48:32.789933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1143/2320] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:32 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:32.852794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:32.861560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-558b6740-0c62-4e37-93c4-d684d1724fe3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152905 Jul 29 06:48:32.862142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1178/2321] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:33.165579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:33.166192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:33.172357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:33.172837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:33.173587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:33.174018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:33.313744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:33.321502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a77ce55d-71a5-4413-a8b6-33b7142e0102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.159896 Jul 29 06:48:33.322063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1144/2322] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:33 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:33.812214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:33.812889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:33.819444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:33.819899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:33.820697 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:33.821140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:33.882416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:33.883304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:33.883927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:33.886594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=80 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:33.891721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:33.892298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:33.892796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:33.893268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:33.893597 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:33.894042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:33.894412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3414fdc0-c445-4d69-864f-1fcb217c0f70 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086169 Jul 29 06:48:33.894974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1179/2323] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:33 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:34.021603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:34.023755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:34.031375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-333442a5-8fd7-42d1-9064-a07c39d0f111 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151933 Jul 29 06:48:34.031935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1145/2324] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:34.344175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:34.344834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:34.346706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=80 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:34.352060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:34.352511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:34.353299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:34.353812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:34.368223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:34.484139 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:34.492077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-61df8c8a-15bf-4413-9371-6221c09490fc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151769 Jul 29 06:48:34.492663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1180/2325] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:34 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:34.918595 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:34.919205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:34.925721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:34.926175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:34.926930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:34.927368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:34.999032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:35.007362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:35.008868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:35.010596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-97cefbba-a3c7-4bd0-8a9a-6636c9dee454 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.096186 Jul 29 06:48:35.011185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1146/2326] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:34 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:35.053098 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:35.053721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:35.060225 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:35.060716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:35.061480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:35.061922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:35.186841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:35.194624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c031309f-28e4-4d2f-9ddf-407240b702c4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.145417 Jul 29 06:48:35.195185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1181/2327] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:35.512968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:35.513577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:35.519542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:35.519986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:35.520769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:35.521201 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:35.648382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:35.656484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-05f09d7f-47a2-4189-8a81-9a1d49d167d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147597 Jul 29 06:48:35.657067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1147/2328] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:35 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:36.034635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:36.035172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:36.041243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:36.041747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:36.042518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:36.042950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:36.103204 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:36.111540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:36.113097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:36.114234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8037d730-3e09-4404-baf7-6f767287615d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083592 Jul 29 06:48:36.114793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1182/2329] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:36 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:36.215778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:36.216389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:36.223149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:36.223599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:36.224349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:36.224809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:36.350841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:36.358784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-18916b36-61d2-4f72-8dd5-9a30bdb9dcb5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147188 Jul 29 06:48:36.359342 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1148/2330] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:36.678728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:36.679349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:36.686114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:36.686566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:36.687333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:36.687777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:36.817499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:36.825760 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-624621eb-adf2-419e-ae26-ac58e4392771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150965 Jul 29 06:48:36.826325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1183/2331] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:36 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:37.138117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:37.138724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:37.144728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:37.145175 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:37.145922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:37.146351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:37.210282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:37.219262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:37.220789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:37.221930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b78f6a09-f330-4785-9e96-3cc66f1903df tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088452 Jul 29 06:48:37.222483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1149/2332] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:37 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:37.380591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:37.381828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:37.389782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:37.390166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:37.390934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:37.391388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:37.521116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:37.529814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-add587f7-adb3-4d90-a001-db47abf04a7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153060 Jul 29 06:48:37.530356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1184/2333] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:37.847238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:37.847861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:37.855026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:37.855480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:37.856246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:37.856716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:37.984875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:37.992755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d5ff3d3-98db-4a50-aeaf-ff4f5343990e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149340 Jul 29 06:48:37.993309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1150/2334] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:37 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:38.245526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:38.246051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:38.252065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:38.252509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:38.253385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:38.253819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:38.317581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:38.326145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:38.327626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:38.328780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2aec7d8a-aace-4a73-8813-1b6ba56d2690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087849 Jul 29 06:48:38.329336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1185/2335] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:38 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:38.551214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:38.551829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:38.558087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:38.558540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:38.559296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:38.559733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:38.575885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:48:38.576371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:48:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:48:38.686501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:38.694251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d01bd1d1-21fd-49c8-95f0-a6fc2793b4d2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146885 Jul 29 06:48:38.694814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1151/2336] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:39.013924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:39.015208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:39.021773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:39.022223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:39.022975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:39.023406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:39.148093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:39.155917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f9216ca-8676-4712-a812-c1fb9a0b351e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146031 Jul 29 06:48:39.156468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1186/2337] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:39 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:39.352638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:39.353283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:39.359806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:39.360260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:39.361053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:39.361499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:39.426061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:39.435072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:39.436604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:39.437755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-03d56649-ee9b-4b87-9e48-7bceaa25ef00 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089079 Jul 29 06:48:39.438324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1152/2338] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:39 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:39.606091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:48:39.606725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:48:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:48:39.716128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:39.716774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:39.723017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:39.723471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:39.724236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:39.724711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:39.851429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:39.859615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1dc1eca1-122f-4297-aadf-ce0b01b90aa3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147730 Jul 29 06:48:39.860108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1187/2339] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:40.177005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:40.177596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:40.184298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:40.184781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:40.185548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:40.185992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:40.315290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:40.323186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-66a12596-efc1-4dfc-9281-81f6b24a5d9f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150101 Jul 29 06:48:40.323751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1153/2340] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:40 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:40.460352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:40.460917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:40.467863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:40.468315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:40.469133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:40.469570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:40.535128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:40.544193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:40.545711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:40.546851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2c6b9dd-5c7f-4c60-bf6d-d88e376e6cb8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090428 Jul 29 06:48:40.547401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1188/2341] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:40 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:40.881473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:40.882093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:40.889181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:40.889633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:40.890397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:40.890838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:41.017347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:41.025920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1fdc7091-37fa-4d53-ba49-b4964fb1c0f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147683 Jul 29 06:48:41.026500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1154/2342] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:41.344630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:41.345411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:41.351622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:41.352077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:41.352902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:41.353337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:41.479493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:41.487388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f3b38c7e-44be-47aa-808d-3cad40a4153d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146642 Jul 29 06:48:41.487941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1189/2343] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:41 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:41.569623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:41.570237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:41.577011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:41.577465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:41.578226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:41.578664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:41.642243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:41.650523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:41.652025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:41.653182 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-200de93b-b846-4a20-9a0a-4bd3213bd3d9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087543 Jul 29 06:48:41.653731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1155/2344] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:41 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:42.047091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:42.047742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:42.053874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:42.054332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:42.055100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:42.055544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:42.181278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:42.189942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8c7fe9f-ebc6-47d3-88b0-6ac3d49fa105 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146701 Jul 29 06:48:42.190503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1190/2345] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:42.508117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:42.508766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:42.515357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:42.515808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:42.516587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:42.517029 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:42.647640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:42.655728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1f916a6a-e0a5-40a1-a186-9857b9b7797e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151414 Jul 29 06:48:42.656328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1156/2346] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:42 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:42.675631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:42.676236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:42.683280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:42.683727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:42.684471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:42.684963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:42.748482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:42.756972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:42.758506 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:42.759581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-131ce454-0090-4a23-a392-bc2fa1d39d34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087807 Jul 29 06:48:42.760198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1191/2347] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:42 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:43.212918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:43.214189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:43.220307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:43.220798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:43.221558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:43.222004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:43.348118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:43.356629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-804a76be-1789-4840-84ec-5751c0784ff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147820 Jul 29 06:48:43.357206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1157/2348] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:43.677759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:43.678377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:43.685401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:43.685853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:43.686613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:43.687050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:43.782508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:43.783220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:43.789504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:43.790037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:43.790882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:43.791400 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:43.818173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:43.826893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7828d6b5-0ad0-4a2b-91c7-294ec00e7740 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152975 Jul 29 06:48:43.827462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1192/2349] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:43 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:43.857992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:43.866594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:43.868103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:43.869262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dc82851d-9824-4df8-8b6a-732a23faebf5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090762 Jul 29 06:48:43.871066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1158/2350] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:43 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:44.377726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:44.378348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:44.384386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:44.384870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:44.386374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:44.386798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:44.512412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:44.520298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-936259ef-4cee-4dce-bbda-db4e879523a5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146460 Jul 29 06:48:44.520891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1193/2351] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:44.848308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:44.848937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:44.855588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:44.856028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:44.856810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:44.857243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:44.893049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:44.893749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:44.900312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:44.901686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:44.902633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:44.903137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:44.975457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:44.984660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:44.986103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:44.987260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef9afd9c-b4eb-4f0a-9af0-b0302ac7542d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.098039 Jul 29 06:48:44.988091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1194/2352] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:44 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:44.990373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:44.999258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-89345799-7a3f-4db0-b885-05031760008b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154758 Jul 29 06:48:44.999814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1159/2353] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:44 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:45.542027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:45.542816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:45.549004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:45.549455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:45.550210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:45.550649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:45.892668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:45.901273 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7902707e-2d2d-4402-99b6-49efd53f7287 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.363264 Jul 29 06:48:45.901994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1195/2354] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:46.009921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:46.011082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:46.017577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:46.018022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:46.018776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:46.019208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:46.021168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:46.021785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:46.027876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:46.028317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:46.029113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:46.029559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:46.080282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:46.089243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:46.090742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:46.091870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6c1fc903-9b2f-46f4-b1a7-ba416d9e1d4a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085814 Jul 29 06:48:46.092424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1160/2355] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:46 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:46.158556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:46.166541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f4376c10-035d-4c6e-a4fa-429b5d57d53a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149140 Jul 29 06:48:46.167108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1196/2356] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:46 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:46.922679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:46.923283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:46.929325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:46.929772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:46.930518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:46.930952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:47.059944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:47.067717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-420fac87-38be-4e37-a0bc-38e07ed90298 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148941 Jul 29 06:48:47.068268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1161/2357] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:47.115195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:47.115840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:47.122839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:47.123318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:47.124076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:47.124514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:47.128375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:47.187412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:47.187831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:47.189351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:47.193927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:47.194370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:47.195125 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:47.195560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:47.198856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:47.200372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:47.201550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a41bc360-13ee-4af2-b78c-39b44860d297 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090294 Jul 29 06:48:47.202110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1197/2358] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:47 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:47.211239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:47.323104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:47.330965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-012e8c6c-b41e-4952-b1aa-bcac5369c7ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147542 Jul 29 06:48:47.331515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1162/2359] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:47 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:48.090302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:48.090918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:48.097044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:48.097492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:48.098245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:48.098681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:48.221603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:48.225493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:48.226179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:48.230330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05fb29f8-ccb5-45f3-ae90-86a5e5e07863 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.144705 Jul 29 06:48:48.230896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1198/2360] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:48.234005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:48.234525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:48.235359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:48.235801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:48.298383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:48.306630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:48.308150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:48.309308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7cef86df-7f4d-43e9-9cea-1912186a6ecd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087797 Jul 29 06:48:48.309858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1163/2361] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:48 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:48.352873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:48.353433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:48.360663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:48.361117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:48.361873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:48.362312 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:48.491079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:48.500007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a14651a-bdc1-467c-8b1d-6ccbb143d361 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150886 Jul 29 06:48:48.500626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1199/2362] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:48 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:49.251465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:49.252073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:49.258601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:49.259050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:49.259809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:49.260376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:49.333779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:49.334400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:49.341453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:49.341913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:49.342688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:49.343130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:49.388968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:49.397178 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d311bb56-f1ad-4838-8649-353b14e0917c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149498 Jul 29 06:48:49.397800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1164/2363] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:49.405129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:49.413793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:49.415289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:49.417164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-03362093-9908-428f-b5b1-3438ec9ac2c6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088656 Jul 29 06:48:49.417884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1200/2364] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:49 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:49.523157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:49.523745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:49.529738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:49.530183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:49.531024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:49.531465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:49.658265 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:49.666128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-33433e6a-c0ab-46cf-aa97-6bc881d5222e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146865 Jul 29 06:48:49.666680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1165/2365] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:49 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:50.419614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:50.420222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:50.426735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:50.427181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:50.427930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:50.428357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:50.440880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:50.441515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:50.448076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:50.448488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:50.449283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:50.449715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:50.512113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:50.520662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:50.522170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:50.523316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-17d2ccf8-80da-44ca-98c5-3f27d48a6bef tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086282 Jul 29 06:48:50.523903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1166/2366] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:50 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:48:50.557618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:50.565437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-279f1cda-cd5c-4ed0-95c4-306062e3e6dc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150338 Jul 29 06:48:50.565997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1201/2367] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:50.687278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:50.687856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:50.693913 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:50.694367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:50.695122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:50.695562 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:50.824777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:50.832834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-91200ebb-a233-40a8-adee-cd54e6c03e19 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149424 Jul 29 06:48:50.833436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1167/2368] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:50 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:51.546605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:51.547208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:51.553219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:51.553662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:51.554413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:51.554843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:51.586339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:51.586943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:51.594533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:51.594986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:51.595772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:51.596206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:51.617181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:51.625977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:51.627486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:51.628661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dcfdb981-903a-4ab4-bd17-8c1ee46865b7 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086138 Jul 29 06:48:51.629420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1202/2369] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:51 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:51.724747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:51.732965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b09469c-6ea7-426d-86a3-1a6ca9c732bb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150177 Jul 29 06:48:51.733334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1168/2370] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:51.854174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:51.854818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:51.860846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:51.861293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:51.862077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:51.862510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:51.995456 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:52.003480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5b92b5da-57b3-488a-8d4b-5b3e9caf0892 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153198 Jul 29 06:48:52.004051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1203/2371] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:51 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:52.652132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:52.652768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:52.659174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:52.659630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:52.660382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:52.660847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:52.721944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:52.731153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:52.732684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:52.733836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b5d744e4-c38c-4251-b126-265c4da22690 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086529 Jul 29 06:48:52.734396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1169/2372] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:52 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:52.754641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:52.755280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:52.762181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:52.762626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:52.763527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:52.763959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:52.890880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:52.898731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6c339fb8-4f23-4f9d-849e-0df8bbf81a6f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147892 Jul 29 06:48:52.899301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1204/2373] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:53.025229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:53.026485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:53.032405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:53.032888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:53.033665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:53.034097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:53.169969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:53.177855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8131bbf3-f427-4896-b53a-ca282aeecfde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156449 Jul 29 06:48:53.178415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1170/2374] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:53 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:53.756127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:53.756772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:53.763447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:53.763900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:53.764810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:53.765251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:53.834195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:53.842989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:53.844582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:53.845803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-22d1378a-b1a6-418c-a027-9c2d90289286 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.093513 Jul 29 06:48:53.846412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1205/2375] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:53 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:53.921472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:53.922081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:53.928119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:53.928600 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:53.929351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:53.929781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:54.057873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:54.065700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-28d0c854-4f8a-4de5-b87e-586a7375ed9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148244 Jul 29 06:48:54.066256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1171/2376] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:54.198794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:54.199398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:54.205321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:54.205767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:54.206511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:54.206941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:54.331753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:54.340433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-26a19b58-e666-4db2-93f0-321e2448bfe2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145442 Jul 29 06:48:54.341033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1206/2377] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:54 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:54.869923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:54.870542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:54.876522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:54.877007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:54.877759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:54.878196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:54.943415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:54.953424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:54.954920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:54.956058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3408914b-1318-447b-9191-ffa8d1b4ede9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090935 Jul 29 06:48:54.956625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1172/2378] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:54 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:55.086665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:55.087279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:55.094501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:55.094964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:55.095735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:55.096179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:55.221636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:55.230335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d8fbfa3c-4f5a-41ea-a411-354c8391a82b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147517 Jul 29 06:48:55.230887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1207/2379] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:55.362121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:55.362753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:55.368760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:55.369834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:55.370614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:55.371047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:55.496273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:55.504260 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ef9bfb4e-d9d8-4d5a-8c0d-3823f979bb9e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145971 Jul 29 06:48:55.504868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1173/2380] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:55 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:55.978730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:55.979347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:55.985503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:55.985912 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:55.986674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:55.987118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:56.051341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:56.059789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:56.061304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:56.062449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ebc98caf-0d82-4157-9986-b04c81c9b59f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087702 Jul 29 06:48:56.063014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1208/2381] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:55 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:56.251093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:56.251629 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:56.258161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:56.258606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:56.259353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:56.260439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:56.386356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:56.394307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0e63fd7a-daad-43ab-86e7-3c49c7930a4c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147116 Jul 29 06:48:56.394877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1174/2382] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:56.524335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:56.524916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:56.531534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:56.531978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:56.532761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:56.533195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:56.662245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:56.670652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2079bce2-0ec0-4b2d-b63d-32978c74c59a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150171 Jul 29 06:48:56.671240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1209/2383] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:56 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:48:57.085386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:57.086074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:57.093147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:57.093594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:57.094354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:57.094790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:57.158451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:57.167734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:57.169272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:57.170410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0befde13-ce59-44ff-a665-96c2bc4a3136 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088994 Jul 29 06:48:57.170964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1175/2384] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:57 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:57.414913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:57.415468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:57.421607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:57.422063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:57.422828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:57.423268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:57.552788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:57.561508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4132f12c-462e-4148-858d-feb1a3ea1517 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150812 Jul 29 06:48:57.562071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1210/2385] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:57.693023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:57.693565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:57.700519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:57.701008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:57.701766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:57.702206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:57.830744 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:57.839835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-65f209da-7551-40cd-8ca6-0d4c29958ed8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150704 Jul 29 06:48:57.840397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1176/2386] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:57 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:58.193385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:58.193989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:58.200712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:58.201100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:58.201844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:58.202275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:58.262364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:58.270607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:58.272091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:58.273240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f545ddb4-60af-4e09-ae80-7d258c05ed3a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083826 Jul 29 06:48:58.273789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1211/2387] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:58 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:58.582297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:58.582837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:58.589399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:58.589855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:58.590611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:58.591048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:58.718659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:58.726962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1be57b11-b7f1-4238-bb8f-330a3adbba64 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148817 Jul 29 06:48:58.727533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1177/2388] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:58.860372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:58.861019 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:58.867559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:58.867997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:58.868787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:58.869952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:58.999231 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:59.007179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-eb004b47-4f23-4491-ab68-0fb0dfe7ad1f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150599 Jul 29 06:48:59.007744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1212/2389] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:58 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:48:59.296668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:59.297196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:59.303219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:59.303668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:59.304423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:59.304888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:59.369766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:59.378156 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:59.379951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:59.381121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a6adc147-7d90-4a35-97b3-17fe25eea1e6 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088486 Jul 29 06:48:59.381674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1178/2390] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:48:59 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:48:59.747875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:48:59.748492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:48:59.754632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:59.755087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:59.755855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:48:59.756298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:48:59.885056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:48:59.887221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:48:59.894424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ba70dda-3e08-41f8-8085-a86591adda1e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151062 Jul 29 06:48:59.895005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1213/2391] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:48:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:00.030745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:00.031289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:00.037799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:00.038513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:00.039263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:00.039696 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:00.043032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:00.171163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:00.179099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cf2a85b1-937c-4712-a651-4afb9d1f3a1c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152275 Jul 29 06:49:00.179652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1179/2392] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:00 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:00.404592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:00.405205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:00.411228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:00.411679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:00.412433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:00.412896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:00.473909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:00.482834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:00.484333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:00.485496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d55f644-3a0e-41c0-ad7e-e848674c640e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085006 Jul 29 06:49:00.486054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1214/2393] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:00 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:00.915591 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:00.916884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:00.922965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:00.923412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:00.924158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:00.924617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:01.054033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:01.062517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0bb76007-f27f-4d1f-ab0c-0893acef7064 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150752 Jul 29 06:49:01.063080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1180/2394] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:01.201072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:01.201686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:01.208087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:01.208546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:01.209330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:01.209786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:01.337872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:01.345730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9cb2a5cc-435f-40b3-9ded-05fb260047ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148920 Jul 29 06:49:01.346290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1215/2395] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:01 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:01.508375 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:01.509024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:01.515087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:01.515530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:01.516276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:01.516739 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:01.580954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:01.590351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:01.591851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:01.593022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-66f2a730-a4b4-46d4-9212-72252bdc988c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088554 Jul 29 06:49:01.593576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1181/2396] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:01 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:02.084902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:02.085516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:02.092807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:02.093199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:02.093956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:02.094393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:02.222567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:02.230429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-78b098c3-d1c6-4cab-9824-105eb3177708 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149382 Jul 29 06:49:02.230994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1216/2397] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:02.367199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:02.367778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:02.374885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:02.375339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:02.376097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:02.376563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:02.502163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:02.510153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bfa949a0-f719-4097-8366-35a6bdfff1a7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146854 Jul 29 06:49:02.510716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1182/2398] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:02 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:02.616683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:02.617465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:02.625308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:02.625915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:02.626875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:02.627319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:02.689344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:02.698604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:02.700118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:02.701297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca3432da-9d50-42f8-8c81-3add975cc5f5 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.088578 Jul 29 06:49:02.701845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1217/2399] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:02 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:03.251809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:03.252353 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:03.258374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:03.258820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:03.260849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:03.261302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:03.387517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:03.395303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6fd0207f-b14f-40d1-a2c6-2cc23be36dc4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147376 Jul 29 06:49:03.395870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1183/2400] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:03.531195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:03.531747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:03.538241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:03.538685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:03.539472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:03.539924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:03.666981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:03.675099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f18640ab-348c-444b-9160-30669c97d89b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147867 Jul 29 06:49:03.675659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1218/2401] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:03 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:03.724222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:03.724875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:03.732135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:03.732619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:03.733386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:03.734034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:03.799672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:03.808069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:03.809586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:03.810711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-41ee4cab-feb7-45c0-b4bf-a0d6f808a985 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090379 Jul 29 06:49:03.811253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1184/2402] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:03 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:04.417524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:04.418131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:04.419988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=78 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:04.425615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:04.426066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:04.426819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:04.427256 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:04.557665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:04.565549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c4d2bce6-d9ba-441f-a94c-6bcc34d9dfa6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152478 Jul 29 06:49:04.566106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1219/2403] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:04.696947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:04.697752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:04.700129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=80 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:04.705723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:04.706168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:04.706916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:04.707347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:04.833458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:04.834072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:04.834445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:04.840784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:04.841241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:04.842016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:04.842459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:04.843365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-093b4614-be07-4362-ae3a-eb7a5c7ca5bd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150399 Jul 29 06:49:04.843934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1185/2404] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:04 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:04.903277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:04.911629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:04.913183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:04.914329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-08dc1938-208b-423f-9eeb-893edbf75a51 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084866 Jul 29 06:49:04.914879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1220/2405] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:04 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:05.586631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:05.587263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:05.594258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:05.594712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:05.595461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:05.595895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:05.721678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:05.730303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1f6df77b-7ee3-497c-8fc4-a815ca54ba7d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147493 Jul 29 06:49:05.730876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1186/2406] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:05.864484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:05.865061 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:05.872194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:05.872675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:05.873440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:05.873878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:05.936776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:05.937390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:05.943516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:05.943999 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:05.944798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:05.945234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:06.002585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:06.010936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9cc16fce-cd4b-411a-85b3-7df11f229a87 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150666 Jul 29 06:49:06.011523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1221/2407] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:05 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:06.011920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:06.020266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:06.021787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:06.022915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-030b3916-da27-4bf7-8768-afa79625c62e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.090063 Jul 29 06:49:06.023456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1187/2408] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:05 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:06.752287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:06.752970 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:06.759046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:06.760026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:06.760824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:06.761266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:06.892034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:06.900484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f7f863c2-8c31-4eca-b565-613c2f2f1a0a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151520 Jul 29 06:49:06.901137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1222/2409] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:07.031560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:07.032142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:07.038669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:07.039116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:07.039865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:07.040302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:07.045980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:07.046639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:07.057377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:07.057840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:07.058621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:07.059067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:07.121562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:07.130711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:07.132218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:07.133388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5b9cb902-9730-4ff2-b095-ae79a8badd3d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.091313 Jul 29 06:49:07.133935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1223/2410] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:07 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:07.173043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:07.181006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d72618ee-8598-46d8-8168-a880d004ceac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153520 Jul 29 06:49:07.181923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1188/2411] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:07 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:07.922063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:07.922679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:07.929241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:07.929692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:07.930454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:07.930890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:08.062621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:08.070584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-475418e2-7d3f-461d-8c12-767f28fbce2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152361 Jul 29 06:49:08.071149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1224/2412] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:08.156849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:08.157466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:08.163854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:08.164306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:08.165109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:08.165543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:08.203150 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:08.203762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:08.209972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:08.210407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:08.211171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:08.211607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:08.227162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:08.235462 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:08.236980 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:08.238142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4bfe7389-994a-4f81-8678-7ab038a44914 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085248 Jul 29 06:49:08.238724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1189/2413] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:08 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:08.340487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:08.348343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-04b6b751-5b04-41c3-8981-cf6607f0d26f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148970 Jul 29 06:49:08.348917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1225/2414] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:08 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:09.093614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:09.094227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:09.100212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:09.100693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:09.101443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:09.101873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:09.230958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:09.238738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ba063d32-ef85-4004-a87f-266daac3f804 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148959 Jul 29 06:49:09.239297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1190/2415] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:09.262005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:09.262615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:09.269039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:09.269493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:09.270252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:09.270691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:09.331516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:09.340884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:09.342388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:09.343525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8b59f0f6-22e6-4cc6-94e3-0245b2c37c2f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085703 Jul 29 06:49:09.344132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1226/2416] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:09 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:09.369738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:09.370367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:09.376316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:09.376794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:09.377541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:09.377972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:09.505158 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:09.512993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca351e41-b995-4ba2-a007-e89ec4cb4de3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147336 Jul 29 06:49:09.513555 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1191/2417] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:10.260997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:10.261600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:10.268034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:10.268638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:10.269253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:10.269682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:10.366372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:10.366975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:10.374499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:10.374978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:10.375736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:10.376164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:10.401262 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:10.409335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a4b8019a-502a-499b-a67f-044e2a83ceeb tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153061 Jul 29 06:49:10.409994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1227/2418] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:10.437088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:10.445413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:10.446964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:10.448097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e91d1313-e773-4708-9f08-a0770249bc6d tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085557 Jul 29 06:49:10.448660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1192/2419] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:10 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:10.534093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:10.534635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:10.541341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:10.541800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:10.542562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:10.543000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:10.669175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:10.676984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3cb6b9ba-b746-4519-9e57-b32ab7f8966c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146842 Jul 29 06:49:10.677544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1228/2420] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:11.431897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:11.432778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:11.439231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:11.439682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:11.440437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:11.440899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:11.470786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:11.471520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:11.478353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:11.478816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:11.479586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:11.480027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:11.543357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:11.551681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:11.553217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:11.554375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8ecd2fe9-6ff8-4096-929d-0098aa553430 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087445 Jul 29 06:49:11.554933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1229/2421] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:11 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:11.574514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:11.582333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c9ac4a73-375a-433d-835a-ea19e5b2ebbc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155013 Jul 29 06:49:11.582895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1193/2422] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:11.698840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:11.699379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:11.705374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:11.705825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:11.706580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:11.707017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:11.722806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:11.838472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:11.846556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-870c9ae1-e4c8-4515-9495-182edce93bec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152457 Jul 29 06:49:11.847122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1230/2423] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:11 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:12.578957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:12.579559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:12.586230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:12.586674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:12.588425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:12.588908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:12.603189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:12.603821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:12.610439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:12.610890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:12.611653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:12.612092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:12.657937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:12.666800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:12.668430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:12.669654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b0907d30-70fd-4e20-84c5-52b6f8b1e80f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.095334 Jul 29 06:49:12.670534 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1194/2424] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:12 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:12.750081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:12.758022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6381444e-8617-4a87-b13c-61f8c371a412 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158728 Jul 29 06:49:12.758586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1231/2425] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:12.867983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:12.869189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:12.875251 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:12.875704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:12.876464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:12.876958 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:13.004016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:13.006230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:13.013780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0c213ece-724d-478e-b266-f069f05e13d0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149675 Jul 29 06:49:13.014346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1195/2426] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:12 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:13.692779 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:13.693387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:13.700767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:13.701221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:13.701976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:13.702414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:13.764076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:13.772451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:13.773997 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:13.775255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bbb6f566-8099-426a-b9ef-bca4a1285cc9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.086386 Jul 29 06:49:13.775818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1232/2427] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:13 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:13.779690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:13.780295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:13.786821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:13.787269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:13.788018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:13.788450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:13.924268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:13.933692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b8b1703-9878-4a99-b230-a1ea7a90e9cd tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158232 Jul 29 06:49:13.934252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1196/2428] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:14.035235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:14.036227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:14.044841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:14.045269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:14.046026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:14.046491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:14.186587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:14.194396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-21b081b8-750a-4eb3-8ccf-a605fcd49813 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.163101 Jul 29 06:49:14.194957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1233/2429] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:14 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:14.797013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:14.797621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:14.804152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:14.804631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:14.805383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:14.805814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:14.866892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:14.875542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:14.877062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:14.878186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-42ef6d1a-5948-4871-a5d4-5d548c3759ae tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085058 Jul 29 06:49:14.878735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1197/2430] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:14 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:14.956186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:14.956880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:14.964405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:14.964874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:14.965629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:14.966060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:15.100762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:15.108909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d9af15a6-772d-4b32-b4da-25258d8165af tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156393 Jul 29 06:49:15.109472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1234/2431] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:15.215453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:15.216083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:15.221994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:15.222441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:15.223186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:15.223615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:15.351320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:15.359813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f7b3216b-e842-4842-924e-54331c2aca98 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148572 Jul 29 06:49:15.360370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1198/2432] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:15 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:15.901047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:15.901652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:15.907692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:15.908141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:15.908918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:15.909356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:15.970881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:15.979682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:15.981247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:15.982429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3218c0a1-4ae1-4f0a-9c64-9bd400b38e81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085730 Jul 29 06:49:15.982928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1235/2433] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:15 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:16.130549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:16.131181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:16.138614 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:16.139065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:16.139820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:16.140256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:16.269307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:16.277233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-98691cbf-b1c1-488d-ac06-ce28580e5fd8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150539 Jul 29 06:49:16.277769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1199/2434] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:16.380419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:16.381054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:16.387184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:16.387629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:16.388407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:16.388872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:16.519107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:16.527696 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d4f90a42-4471-4c7e-bd51-ca2d0e6edaa6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151089 Jul 29 06:49:16.528243 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1236/2435] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:17.005624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:17.006254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:17.012777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:17.013225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:17.013976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:17.014405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:17.074429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:17.082613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:17.084099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:17.085264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f4e9d878-fdef-41f8-8106-e56c8c359242 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.083520 Jul 29 06:49:17.085814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1200/2436] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:17 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:17.298951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:17.299586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:17.306085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:17.306528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:17.307282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:17.307714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:17.434240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:17.442094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8eff6eef-1721-4f62-bd19-1e507b317e35 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146946 Jul 29 06:49:17.442662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1237/2437] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:17.548131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:17.548778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:17.555253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:17.555701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:17.557461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:17.558010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:17.690022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:17.698780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bb9cccca-748c-4b9a-8413-06b8e3ec9bf2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154370 Jul 29 06:49:17.699338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1201/2438] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:17 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:18.109368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:18.109987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:18.116031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:18.116489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:18.117285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:18.117726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:18.181511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:18.189895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:18.191398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:18.192563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9ccc9f41-aabe-4c3a-be46-2740775e3725 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087155 Jul 29 06:49:18.193123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1238/2439] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:18 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:18.464941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:18.465567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:18.471582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:18.472027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:18.472817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:18.473249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:18.599706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:18.607667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4d19faeb-9260-44ea-ad44-5afb9d53de26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147415 Jul 29 06:49:18.608226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1202/2440] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:18.721509 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:18.722070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:18.728849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:18.729295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:18.730050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:18.730513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:18.855342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:18.863124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0002e302-8be8-4503-8f6a-ea77e8336e55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145523 Jul 29 06:49:18.863677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1239/2441] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:18 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:19.216219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:19.216863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:19.222916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:19.223363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:19.224117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:19.224569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:19.286160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:19.294550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:19.296059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:19.297246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2645d01f-a8c4-43a2-98a8-197d3b44cb87 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.085855 Jul 29 06:49:19.297791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1203/2442] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:19 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:19.628616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:19.629226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:19.635925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:19.636368 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:19.637141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:19.637579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:19.763962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:19.771848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f2d37a84-da4b-44c9-84f8-2d17bf38ba0b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147172 Jul 29 06:49:19.772407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1240/2443] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:19.884939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:19.885690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:19.892041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:19.892485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:19.893269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:19.893703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:20.028871 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:20.036731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b3e04583-4b6b-4203-8379-59e9c823401a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156388 Jul 29 06:49:20.037289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1204/2444] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:19 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:20.320777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:20.321320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:20.327288 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:20.327745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:20.328492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:20.328946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:20.392265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:20.401240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:20.402726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:20.403858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-31ff47c2-5159-4e4a-82da-a35514fc6b95 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087054 Jul 29 06:49:20.404402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1241/2445] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:20 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:20.793345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:20.793951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:20.799914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:20.800365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:20.801174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:20.801605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:20.929379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:20.937642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d21029be-a4b2-4279-abfd-07dab8fa7f01 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148161 Jul 29 06:49:20.938216 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1205/2446] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:21.058235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:21.058776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:21.066177 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:21.066625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:21.067380 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:21.067815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:21.215548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:21.224182 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b365d75b-ceed-4cb1-92f5-5babb73cece7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.169889 Jul 29 06:49:21.225086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1242/2447] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:21 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:21.426992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:21.427602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:21.434001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:21.434453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:21.435226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:21.435660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:21.505733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:21.515145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:21.516661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:21.517810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b764283e-7fbd-4ea4-b9f2-062aab90de5a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.094747 Jul 29 06:49:21.518366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1206/2448] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:21 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:21.959042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:21.959649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:21.966188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:21.966691 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:21.967381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:21.967811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:22.095181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:22.103035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4596bf05-4134-4bec-abbb-712fde2b8d8f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147774 Jul 29 06:49:22.103591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1243/2449] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:22.249780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:22.250390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:22.257599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:22.258045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:22.259317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:22.259793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:22.390441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:22.398474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a65f6224-64f6-4450-8b74-b98c836e2497 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152504 Jul 29 06:49:22.399062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1207/2450] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:22 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:22.543909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:22.544511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:22.550488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:22.550929 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:22.551674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:22.552103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:22.622699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:22.632417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:22.633986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:22.635284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b6a1652-6b8d-4e1d-a058-48bcaa3d9842 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.095949 Jul 29 06:49:22.635851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1244/2451] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:22 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:23.123617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:23.124255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:23.130393 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:23.130842 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:23.131590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:23.132023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:23.262657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:23.270939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2060c2a8-e693-4b21-94a2-166b8328722d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151169 Jul 29 06:49:23.271506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1208/2452] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:23.419622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:23.420271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:23.426780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:23.427241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:23.428000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:23.428442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:23.558986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:23.566917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1f741dc3-9b35-4dc2-b4fe-768f412ffe4e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151271 Jul 29 06:49:23.567473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1245/2453] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:23 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:23.658248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:23.658852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:23.665002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:23.665645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:23.666185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:23.666620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:23.727025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:23.736261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:23.737782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:23.738917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cee9ae90-2c9b-44cd-be43-5e2503e5641b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.084519 Jul 29 06:49:23.739490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1209/2454] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:23 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:24.292200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:24.292777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:24.298786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:24.299226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:24.299975 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:24.300441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:24.427226 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:24.435939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-754a4b90-fa99-411a-b532-def5a0e6a697 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147773 Jul 29 06:49:24.436508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1246/2455] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:24.589215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:24.590446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:24.596886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:24.597333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:24.598083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:24.598514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:24.728072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:24.736486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8cb961ab-8d0e-48e7-8d98-24aaf273e921 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151435 Jul 29 06:49:24.737107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1210/2456] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:24 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:24.762768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:24.763401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:24.769436 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:24.769885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:24.770638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:24.771074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:24.773600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:24.835840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:24.845029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:24.846492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:24.847614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1c00e07b-942b-46e2-b068-41eebb2aaea0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.089508 Jul 29 06:49:24.848166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1247/2457] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:24 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:25.457818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:25.458425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:25.464908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:25.465354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:25.466104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:25.466535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:25.594261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:25.602160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d8c7b8b-ac0d-4c77-a047-678e9ea7abd7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148146 Jul 29 06:49:25.602847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1211/2458] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:25.758193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:25.759601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:25.766045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:25.766484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:25.767229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:25.767659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:25.870598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:25.871319 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:25.877799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:25.878271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:25.879013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:25.879457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:25.895316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:25.897642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:25.905902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c59ba734-ede9-47cd-b7bc-5a572389795f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151450 Jul 29 06:49:25.906473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1248/2459] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:25 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:25.941529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:25.950682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:25.952176 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:25.953337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-068cec45-0b30-4d62-ab73-d635cca3eb74 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 200 len: 1443 microversion: 2.20 time: 0.087289 Jul 29 06:49:25.953887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1212/2460] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:25 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:25.976666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c313eacc-b58d-4a33-a342-c065ce0ed696 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '.version_select at 0x7f145e2f5dc0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:26.000003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c313eacc-b58d-4a33-a342-c065ce0ed696 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-562867276" status: 204 len: 0 microversion: 2.20 time: 0.027447 Jul 29 06:49:26.000493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1249/2461] 10.222.0.33 () {60 vars in 1259 bytes} [Fri Jul 29 06:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-562867276 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 06:49:26.624799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:26.625299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:26.631279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:26.631741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:26.632500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:26.632964 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:26.766601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:26.778602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c21553e8-f1a2-47ff-bb25-a34ae937528f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.158021 Jul 29 06:49:26.778826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-892ac7ac-623c-48f3-a512-9ea22c84a6d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'create', calling method: .version_select at 0x7f145e35fca0>, body: {"keypair": {"name": "tempest-keypair-1844759825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwhbPjuBXFIGG+QsV8izuR1Fad5YVSe26bEPi0DSq0t8WWTjoo4KkqBAUXSlGK3H9e3jtMC40Qe16qVnosPo6JtaU3jdK+d4+WEVRbuNPtS07biKOcXPFzwqUaECouwVg=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:49:26.785149 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1213/2462] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:26.796407 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-892ac7ac-623c-48f3-a512-9ea22c84a6d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for project f8d1f62a52884ebb91749ef49de11bec. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:49:26.800251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-892ac7ac-623c-48f3-a512-9ea22c84a6d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for user 217b321936224e2ba928b983c4e40017 and project f8d1f62a52884ebb91749ef49de11bec. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:49:26.824799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-892ac7ac-623c-48f3-a512-9ea22c84a6d8 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050881 Jul 29 06:49:26.825397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1250/2463] 10.222.0.33 () {62 vars in 1200 bytes} [Fri Jul 29 06:49:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 06:49:26.927746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:26.928515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:26.935113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:26.935570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:26.936333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:26.936796 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:27.121432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:27.130092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-40da3029-2cce-4052-a2df-1f8e965bd928 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.206798 Jul 29 06:49:27.143995 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1214/2464] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:26 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:27.800801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:27.801398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:27.807646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:27.808097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:27.808894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:27.809339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:27.943483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:27.952355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a107f33-1b3d-4ccc-938a-056684d49de6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156284 Jul 29 06:49:27.952955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1251/2465] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:27 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:28.124441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-886814831", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "40674957-e65b-42f3-b74b-29bebe673dc8"}], "security_groups": [{"name": "tempest-securitygroup--1134006499"}], "key_name": "tempest-keypair-1844759825", "user_data": "}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:49:28.151336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:28.151948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:28.157940 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:28.158390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:28.159145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:28.159596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:28.228270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] validate_networks() for [('40674957-e65b-42f3-b74b-29bebe673dc8', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:49:28.287066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:28.295825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3137e60d-44a0-448e-94c1-2448d2b2133c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148476 Jul 29 06:49:28.296381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1252/2466] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:28 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:28.651021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:49:28.651445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:49:28.651971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:49:28.652361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:49:28.652797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:49:28.661580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:28.662024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:28.662816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:28.663248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:28.679593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for project f8d1f62a52884ebb91749ef49de11bec. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:49:28.683957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Getting quotas for user 217b321936224e2ba928b983c4e40017 and project f8d1f62a52884ebb91749ef49de11bec. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:49:28.694716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:49:28.697780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:49:28.744184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5d3cbeca-76e6-4eb6-ade6-0c2faa82560c tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.624022 Jul 29 06:49:28.745066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1215/2467] 10.222.0.33 () {62 vars in 1188 bytes} [Fri Jul 29 06:49:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 06:49:28.755903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7abb8c88-06f4-4ba3-a764-18c6e1c68358 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:28.756532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7abb8c88-06f4-4ba3-a764-18c6e1c68358 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:28.815678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7abb8c88-06f4-4ba3-a764-18c6e1c68358 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:28.823739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7abb8c88-06f4-4ba3-a764-18c6e1c68358 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:28.825267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7abb8c88-06f4-4ba3-a764-18c6e1c68358 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:28.826367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7abb8c88-06f4-4ba3-a764-18c6e1c68358 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1281 microversion: 2.20 time: 0.074306 Jul 29 06:49:28.826922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1253/2468] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:28 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1281 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:28.974160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:28.974797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:28.981632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:28.982091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:28.982864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:28.983307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:29.135166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:29.144468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fcfa9618-08d9-4365-ad80-a8fe5b2915d4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.174102 Jul 29 06:49:29.145074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1216/2469] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:29.317295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:29.317906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:29.323983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:29.324844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:29.325611 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:29.326245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:29.459006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:29.467807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f18916ca-17cb-4add-a9d9-bd21c2dc1058 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154272 Jul 29 06:49:29.468375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1254/2470] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:29 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:29.848436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:29.849191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:29.855510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:29.856088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:29.856989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:29.857520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:29.925275 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:29.934079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:29.935602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:29.936724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b50621e-c11e-4f88-afaf-c5947678a30b tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1339 microversion: 2.20 time: 0.092215 Jul 29 06:49:29.937273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1217/2471] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:29 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1339 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 06:49:30.168353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:30.169250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:30.175743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:30.176189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:30.176990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:30.177429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:30.404901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:30.412847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e7c67cd3-e841-4d44-8d8c-b125e785da14 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.249149 Jul 29 06:49:30.413413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1255/2472] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:30.489914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:30.490601 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:30.498435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:30.499031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:30.499882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:30.500394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:30.654385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:30.662953 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0be63830-f010-455e-94e7-8da3221ddb2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.177089 Jul 29 06:49:30.668586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1218/2473] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:30 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:30.959371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:30.960350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:30.967355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:30.968027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:30.968830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:30.969269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:31.330504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-45555b94-3aa5-44e0-ad57-ab7c686dc8f8 req-9557d95f-2d55-4ca5-958e-175141b21ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb95b1b-f883-46e7-90c8-a740a4a27ca9", "tag": "f8e6adff-418f-4832-8f59-ec5ea31168b9"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:49:31.341085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-45555b94-3aa5-44e0-ad57-ab7c686dc8f8 req-9557d95f-2d55-4ca5-958e-175141b21ec4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:31.341545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-45555b94-3aa5-44e0-ad57-ab7c686dc8f8 req-9557d95f-2d55-4ca5-958e-175141b21ec4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:31.353783 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-45555b94-3aa5-44e0-ad57-ab7c686dc8f8 req-9557d95f-2d55-4ca5-958e-175141b21ec4 service nova] Creating event network-changed:f8e6adff-418f-4832-8f59-ec5ea31168b9 for instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 on hv-cinder-83482 Jul 29 06:49:31.363209 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-45555b94-3aa5-44e0-ad57-ab7c686dc8f8 req-9557d95f-2d55-4ca5-958e-175141b21ec4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122230 Jul 29 06:49:31.363826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1219/2474] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:49:31.404727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:31.412963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:31.415218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:31.416428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b530ebbe-5a68-41b0-a5f2-a42bbfc42301 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1407 microversion: 2.20 time: 0.460980 Jul 29 06:49:31.417108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1256/2475] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:30 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:31.437602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:31.438341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:31.444723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:31.445177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:31.445972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:31.446404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:31.588345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:31.596402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a2fab34d-5c22-42d6-89be-5479369d4cae tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.163574 Jul 29 06:49:31.597005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1220/2476] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:31.685764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:31.686420 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:31.692406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:31.692894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:31.693648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:31.694082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:31.822271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:31.830125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b4e72424-658b-4cc5-aee6-c67f06e9eb55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148314 Jul 29 06:49:31.830690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1257/2477] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:31 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:32.439317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:32.439920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:32.446518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:32.446972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:32.447712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:32.448144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:32.589415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:32.598310 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:32.600123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:32.602550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b82c2b3d-f6e9-43b6-a6db-bdd6646b6baa tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1407 microversion: 2.20 time: 0.166316 Jul 29 06:49:32.603741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1221/2478] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:32 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:32.626240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:32.627867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:32.637410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:32.637410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:32.638186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:32.638859 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:32.853455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:32.854116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:32.857911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:32.860362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:32.860810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:32.861569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:32.862633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:32.866546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-54ffcbd7-87b7-426b-beea-22e24941f555 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.252399 Jul 29 06:49:32.867131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1258/2479] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:32.998893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:33.007292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5c07bd96-b099-4723-8910-577228943c47 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.157698 Jul 29 06:49:33.010636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1222/2480] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:32 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:33.626687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:33.627279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:33.634846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:33.635571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:33.636347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:33.636806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:33.763083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:33.770836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:33.772319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:33.773438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a6a0003b-23c2-4e69-9c10-6131d0dfc8c3 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1407 microversion: 2.20 time: 0.150695 Jul 29 06:49:33.774043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1259/2481] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:33 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:33.888198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:33.888885 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:33.895408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:33.895856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:33.896631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:33.897063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:34.027948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:34.030003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:34.030606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:34.036049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6022126b-583b-4a9b-bbf5-73b28351fff7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152281 Jul 29 06:49:34.036625 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1223/2482] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:34.037105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:34.037549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:34.038306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:34.038739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:34.165881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:34.173838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ac8f106d-ba3f-4be5-8201-d661559d8875 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147662 Jul 29 06:49:34.174397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1260/2483] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:34 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:34.796946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:34.797563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:34.799553 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:34.804929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:34.805557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:34.806322 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:34.806759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:34.934484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:34.942413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:34.943925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:34.945072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5497b85d-c41d-406d-88a9-80f021de414e tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1407 microversion: 2.20 time: 0.152054 Jul 29 06:49:34.945631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1224/2484] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:34 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:35.057804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:35.058428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:35.060832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:35.066213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.066668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:35.067444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.067893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:35.175789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-188f4e80-d33e-4665-8fec-220f351ad511 req-312b74ec-b815-4d2a-841e-99e12fe0b915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb95b1b-f883-46e7-90c8-a740a4a27ca9", "name": "network-vif-plugged", "status": "completed", "tag": "f8e6adff-418f-4832-8f59-ec5ea31168b9"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:49:35.188228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-188f4e80-d33e-4665-8fec-220f351ad511 req-312b74ec-b815-4d2a-841e-99e12fe0b915 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.188728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-188f4e80-d33e-4665-8fec-220f351ad511 req-312b74ec-b815-4d2a-841e-99e12fe0b915 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:35.201043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-188f4e80-d33e-4665-8fec-220f351ad511 req-312b74ec-b815-4d2a-841e-99e12fe0b915 service nova] Creating event network-vif-plugged:f8e6adff-418f-4832-8f59-ec5ea31168b9 for instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 on hv-cinder-83482 Jul 29 06:49:35.206017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-188f4e80-d33e-4665-8fec-220f351ad511 req-312b74ec-b815-4d2a-841e-99e12fe0b915 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096965 Jul 29 06:49:35.207742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1225/2485] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:49:35.207873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:35.213926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:35.215615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:35.217180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f289463-2273-46ec-82b0-158761c904a2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.162989 Jul 29 06:49:35.222516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.223032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:35.223801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.224321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:35.231437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1261/2486] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:35.367171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:35.375994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0f5aceaa-b6be-4a91-afd9-b39a275b46dc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.167158 Jul 29 06:49:35.376623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1226/2487] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:35 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:35.974329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:35.975042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:35.981981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.982408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:35.983173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:35.983654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:36.111711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:36.119462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:36.120960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:36.122056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4b189b95-0053-4dbe-80fd-b1713533f936 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1407 microversion: 2.20 time: 0.151885 Jul 29 06:49:36.122599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1262/2488] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:35 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:36.238779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:36.239303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:36.246019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:36.246467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:36.247214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:36.247643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:36.375312 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:36.383303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-940e2b67-ca82-4124-a632-09dfb0b770ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148473 Jul 29 06:49:36.383863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1227/2489] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:36.397753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:36.398405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:36.405339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:36.405797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:36.406565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:36.407003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:36.537348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:36.545275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-790d40f4-0fcd-4a74-8e00-1a5f2c8c717e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151374 Jul 29 06:49:36.545831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1263/2490] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:36 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:37.144085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:37.144723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:37.151214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.151674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.152434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.152930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.278318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:37.286368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:37.287855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:37.289136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-64f7b614-2c99-4896-a8f9-cbd973d2ba9f tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1599 microversion: 2.20 time: 0.148996 Jul 29 06:49:37.290266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1228/2491] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:49:37 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1599 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:49:37.312286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:37.312831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:37.319253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.319702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.320453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.320962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.395176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5e7c08f9-883c-4952-b1c2-dac6040c608a tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.086677 Jul 29 06:49:37.395710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1264/2492] 10.222.0.33 () {60 vars in 1316 bytes} [Fri Jul 29 06:49:37 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:49:37.404680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:37.405292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:37.411522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.412007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.412790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.413227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.545544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:37.553593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-534ecbe5-66ea-4288-8117-92a182b78065 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152899 Jul 29 06:49:37.561635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1229/2493] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:37.567321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:37.567938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:37.574952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.575403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.576192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:37.576757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:37.817857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:37.826448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-155d98ba-72c8-4a29-862c-3e5c49df42aa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.262939 Jul 29 06:49:37.827013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1265/2494] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:37 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:38.397289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-82e29935-9b00-44ac-a11b-6bfe753924a7 req-6b394276-2593-40fb-8f00-0359bd12a3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbb95b1b-f883-46e7-90c8-a740a4a27ca9", "tag": "f8e6adff-418f-4832-8f59-ec5ea31168b9"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:49:38.407778 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-82e29935-9b00-44ac-a11b-6bfe753924a7 req-6b394276-2593-40fb-8f00-0359bd12a3af service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:38.408226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-82e29935-9b00-44ac-a11b-6bfe753924a7 req-6b394276-2593-40fb-8f00-0359bd12a3af service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:38.419598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-82e29935-9b00-44ac-a11b-6bfe753924a7 req-6b394276-2593-40fb-8f00-0359bd12a3af service nova] Creating event network-changed:f8e6adff-418f-4832-8f59-ec5ea31168b9 for instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 on hv-cinder-83482 Jul 29 06:49:38.424419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-82e29935-9b00-44ac-a11b-6bfe753924a7 req-6b394276-2593-40fb-8f00-0359bd12a3af service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030722 Jul 29 06:49:38.425223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1230/2495] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:49:38.575460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:38.576006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:38.583159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:38.583485 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:38.584255 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:38.584971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:38.792880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:38.801046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d13aa0aa-12ce-45aa-bf1c-8fe8376e25f5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.230093 Jul 29 06:49:38.808882 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1266/2496] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:38.844484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:38.845593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:38.849942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:38.851482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:38.860199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:38.860934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:38.862380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:38.862930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:39.019226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:39.021856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:39.042915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f3024c06-6c97-488d-a4ed-aaa36d3bcf30 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.199257 Jul 29 06:49:39.044708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1231/2497] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:38 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:39.822659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:39.823298 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:39.825187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:39.831439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:39.831896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:39.832688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:39.833129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:39.837041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:39.965672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:39.973711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3521542d-5772-4238-885f-1df285227d6b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154957 Jul 29 06:49:39.974872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1267/2498] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:40.065389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:40.065944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:40.072511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:40.073004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:40.073770 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:40.074217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:40.202679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:40.210645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7dd7134b-93c9-49f2-b78b-2e0bd95adc0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149165 Jul 29 06:49:40.211207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1232/2499] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:40 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:40.995492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:40.996004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:41.002516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:41.002965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:41.003711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:41.004142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:41.129172 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:41.138475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f659a94-ed8a-4e3b-87b2-4c500203d408 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146964 Jul 29 06:49:41.139232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1268/2500] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:41.231838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:41.232452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:41.238962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:41.239414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:41.240170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:41.240643 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:41.369223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:41.377180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-faed5060-e173-48ae-a160-cef4fca42b37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149215 Jul 29 06:49:41.377745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1233/2501] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:41 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:42.159856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:42.160471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:42.167006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:42.167457 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:42.168218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:42.168690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:42.298198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:42.306655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7e4e706b-d565-4d5e-930f-bcc573531d37 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150639 Jul 29 06:49:42.307214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1269/2502] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:42.398692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:42.399440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:42.405932 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:42.406383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:42.407140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:42.407610 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:42.535221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:42.543826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dec61f4d-ce7c-466c-b170-c9334c510fa0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148956 Jul 29 06:49:42.544386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1234/2503] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:42 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:43.328047 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:43.328673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:43.335109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:43.335553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:43.337109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:43.337545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:43.466579 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:43.474385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5c5a7145-c37f-42dc-90cd-8b22319d5511 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150228 Jul 29 06:49:43.474934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1270/2504] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:43.565355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:43.565970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:43.573141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:43.573596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:43.574371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:43.574813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:43.700109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:43.707984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eaa40e68-872e-409f-b289-6ca73b082b60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146509 Jul 29 06:49:43.708564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1235/2505] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:43 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:44.495323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:44.495938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:44.502452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:44.502936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:44.503699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:44.504137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:44.630576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:44.638964 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-438b2f4b-3820-43e7-9407-ef4cfb7eba47 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147539 Jul 29 06:49:44.639507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1271/2506] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:44.730303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:44.730854 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:44.737512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:44.737967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:44.738730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:44.739172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:44.866118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:44.874765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-eee4a588-bd26-4fb7-8e60-ae7654fcb35a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148401 Jul 29 06:49:44.875333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1236/2507] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:44 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:45.660619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:45.661233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:45.667889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:45.668338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:45.669136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:45.669581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:45.799087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:45.807730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a899ff14-743e-4fd3-8b30-9acba2a8ba28 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151016 Jul 29 06:49:45.808293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1272/2508] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:45.896971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:45.897585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:45.904804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:45.905258 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:45.906013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:45.906455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:46.038592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:46.046936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca7b3a57-ee57-4330-8f01-5c4971bd0f37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153785 Jul 29 06:49:46.047500 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1237/2509] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:45 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:46.831230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:46.832109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:46.840814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:46.841334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:46.842379 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:46.843035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:46.972011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:46.981011 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f79f9cb-3002-42ee-8dd1-28b802970ad4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153736 Jul 29 06:49:46.981567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1273/2510] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:47.068704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:47.069249 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:47.075820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:47.076307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:47.077111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:47.077557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:47.204383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:47.213190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd98b847-78a4-407d-aa2e-b5b1ecbfad2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148179 Jul 29 06:49:47.213762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1238/2511] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:47 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:48.002586 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:48.003138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:48.010360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:48.010817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:48.011575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:48.012016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:48.140332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:48.148193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5038c31e-23b9-471c-add3-4ec02ba75869 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149530 Jul 29 06:49:48.148843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1274/2512] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:47 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:48.234046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:48.234654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:48.241080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:48.241547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:48.242370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:48.242989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:48.372000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:48.379774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-105eadda-1bdf-4a5b-b2cd-386741801ca1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149517 Jul 29 06:49:48.380333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1239/2513] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:48 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:49.170245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:49.170863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:49.177463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:49.177914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:49.178682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:49.179120 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:49.312394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:49.322313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-120854cb-2816-4b33-b026-ff2e79c49f82 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154053 Jul 29 06:49:49.322313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1275/2514] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:49.401861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:49.402405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:49.409434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:49.409897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:49.410660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:49.411103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:49.540741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:49.548976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1900ffb7-92b6-4d96-92e7-7184d41e3ac9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151484 Jul 29 06:49:49.549549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1240/2515] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:49 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:50.342299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:50.342916 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:50.349514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:50.349968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:50.350726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:50.351166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:50.479099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:50.486927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e8fa516d-88b0-4c28-96c1-9f97e4e0d2e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148485 Jul 29 06:49:50.487484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1276/2516] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:50.571654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:50.572277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:50.578755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:50.579205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:50.579960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:50.580396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:50.706092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:50.714346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5acc3c6e-01a5-4629-9e29-b18feb24d677 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147307 Jul 29 06:49:50.714915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1241/2517] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:50 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:51.508648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:51.510639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:51.516962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:51.517422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:51.518202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:51.518649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:51.651933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:51.659756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3fbd325e-d66d-49fa-9b83-3caf063f8cdf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155757 Jul 29 06:49:51.660254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1277/2518] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:51.735800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:51.736450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:51.743691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:51.744141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:51.744931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:51.745372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:51.885122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:51.893004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d1747839-bf5b-43e2-b7e8-2060faa667cf tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.160964 Jul 29 06:49:51.893517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1242/2519] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:51 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:52.680701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:52.681488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:52.687990 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:52.688446 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:52.689241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:52.689684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:52.816840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:52.825393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-adc4d998-8b8b-4487-bf0c-0177d4ffd55c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148622 Jul 29 06:49:52.825955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1278/2520] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:52.914681 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:52.915271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:52.921772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:52.922215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:52.922961 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:52.923389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:53.052879 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:53.060939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-74721f0e-6db4-4d1e-8616-62b9c7b875ab tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150157 Jul 29 06:49:53.061494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1243/2521] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:52 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:53.847297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:53.847978 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:53.856171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:53.856651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:53.857428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:53.857896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:53.987078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:53.996091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-206bdc94-1d5f-4f15-a017-dca2f8050ca0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152729 Jul 29 06:49:53.996661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1279/2522] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:54.083028 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:54.083636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:54.090895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:54.091344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:54.092120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:54.092573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:54.221670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:54.230355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8800fe2b-6d4c-4b45-bb74-3f16ecbe98ba tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151327 Jul 29 06:49:54.230908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1244/2523] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:54 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:54.456093 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:49:54.456276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:49:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:49:55.016814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:55.017462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:55.023895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:55.024344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:55.025320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:55.025800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:55.151953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:55.159860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca792ea5-fc41-4275-b863-3cbb104499d7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146989 Jul 29 06:49:55.160408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1280/2524] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:55.251987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:55.252636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:55.259135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:55.259569 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:55.260315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:55.260779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:55.387432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:55.395348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9dc0e6d1-96b5-4071-953d-ee4775d9e317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147191 Jul 29 06:49:55.395908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1245/2525] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:55 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:56.181772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:56.182392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:56.188928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:56.189390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:56.190156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:56.190599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:56.417901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:56.418533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:56.425537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:56.425992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:56.426768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:56.427207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:56.548308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:56.556664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8316be2c-11ac-4da8-8e48-f860a4c54d05 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.378838 Jul 29 06:49:56.557236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1281/2526] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:56.565250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:56.573757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f1c591c0-9eac-4b4d-9d61-6962c0a79c37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.160915 Jul 29 06:49:56.574320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1246/2527] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:56 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:57.577977 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:57.578501 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:57.584982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:57.585434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:57.586194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:57.586635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:57.595032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:57.595645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:57.602121 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:57.603126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:57.604573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:57.605017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:57.721770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:57.731458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d00c216-3cef-4c40-b818-7a18b02db1c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.157287 Jul 29 06:49:57.732360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1282/2528] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:57.992136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:58.000951 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-70dbc5c2-1553-4a03-9112-187eea858e65 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.409684 Jul 29 06:49:58.001848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1247/2529] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:57 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:49:58.753455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:58.754085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:58.761253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:58.761701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:58.762451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:58.762915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:58.895153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:58.897357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:58.904812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4f5434c5-aae9-479e-88f1-1dcfebfa4202 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155093 Jul 29 06:49:58.905373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1283/2530] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:59.021892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:59.022417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:59.029673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:59.030120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:59.030873 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:59.031306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:59.046545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:49:59.158127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:49:59.166579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f085cd2a-ac32-4967-b374-67070a568992 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148565 Jul 29 06:49:59.167143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1248/2531] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:59 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:49:59.925984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:49:59.926590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:49:59.933211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:59.933653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:49:59.934447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:49:59.934880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:00.063056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:00.070880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6cbbe270-4295-43bb-831d-4898fd8688c3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148809 Jul 29 06:50:00.071437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1284/2532] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:49:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:00.187139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:00.187749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:00.194237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:00.194683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:00.195427 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:00.195860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:00.325920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:00.333722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-780e89bb-6b87-457a-b145-3858c69c6abd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150383 Jul 29 06:50:00.334288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1249/2533] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:00 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:00.655559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:50:00.655769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:50:01.092954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:01.093630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:01.100106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:01.100594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:01.101358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:01.101796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:01.228608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:01.236431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d4b84a46-a155-44b6-a96f-d546de093318 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147332 Jul 29 06:50:01.237017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1285/2534] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:01 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:01.357390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:01.357919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:01.364421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:01.364908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:01.365666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:01.366104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:01.492467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:01.501328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-08ee9d78-60b1-4073-8e60-d2f6c599cea8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147877 Jul 29 06:50:01.501893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1250/2535] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:01 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:02.257547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:02.258079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:02.264665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:02.265117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:02.265872 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:02.266569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:02.396432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:02.405123 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-971e7f96-eac3-4132-8f48-0b66a8dc6b5d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151504 Jul 29 06:50:02.405679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1286/2536] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:02.522917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:02.523449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:02.530669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:02.531116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:02.531870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:02.532304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:02.666556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:02.674438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8edf6a04-4107-4e5d-b17b-b51ad74d3ba9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.155421 Jul 29 06:50:02.674992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1251/2537] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:02 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:03.426524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:03.427160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:03.433873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:03.434316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:03.435069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:03.435500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:03.563025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:03.570927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d1cf999-7554-474d-a990-ba6e525c41ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148221 Jul 29 06:50:03.572266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1287/2538] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:03.695096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:03.695646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:03.702721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:03.703180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:03.703939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:03.704384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:03.831270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:03.839712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a07f3812-f476-4ef7-b001-9e5b1bfcb9e5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148467 Jul 29 06:50:03.840280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1252/2539] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:03 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:04.593781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:04.594388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:04.600799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:04.601251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:04.602002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:04.603130 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:04.732194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:04.740179 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1235a4ea-a6a0-45b4-bf7a-73350662d30f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150203 Jul 29 06:50:04.740776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1288/2540] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:04.860794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:04.861336 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:04.863638 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=58 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:04.870079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:04.870533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:04.871294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:04.871732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:05.001606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:05.009647 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e7b0344b-7114-4156-a883-34a64cf20889 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152708 Jul 29 06:50:05.010225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1253/2541] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:04 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:05.762866 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:05.763481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:05.765792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=56 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:05.771037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:05.771488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:05.772247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:05.772721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:05.901053 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:05.908953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-81936dd1-2b80-4a0d-ad3e-ae18e5c17255 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150820 Jul 29 06:50:05.909550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1289/2542] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:06.030161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:06.030776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:06.037232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:06.037692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:06.038448 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:06.038884 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:06.164836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:06.172606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f85c22af-fe82-4119-90fd-b0be9a726b1d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146244 Jul 29 06:50:06.173163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1254/2543] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:06 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:06.931696 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:06.932317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:06.938869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:06.939331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:06.940099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:06.940557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:07.065340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:07.073619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-335ca74c-4a02-4b24-8320-ff33dcef9eaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146597 Jul 29 06:50:07.074176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1290/2544] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:07.194256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:07.194864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:07.201370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:07.201817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:07.202589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:07.203021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:07.333774 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:07.342761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bc48bd86-15a3-4cfa-9583-16b8fa2ce187 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152300 Jul 29 06:50:07.343331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1255/2545] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:07 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:08.001465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:08.001960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:08.008459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:08.009108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:08.009915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:08.010344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:08.033188 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f6972cf-90fa-455b-8c1c-cad8fc5e3395 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9/ips" status: 200 len: 152 microversion: 2.20 time: 0.035874 Jul 29 06:50:08.033742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1291/2546] 10.222.0.33 () {60 vars in 1289 bytes} [Fri Jul 29 06:50:07 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 06:50:08.095544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:08.096155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:08.102698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:08.103148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:08.103897 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:08.104328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:08.233197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:08.241133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1b3229aa-1cd3-4139-87c7-d259c69891d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149355 Jul 29 06:50:08.241667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1256/2547] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:08 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:08.363220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:08.363868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:08.370003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:08.370459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:08.371220 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:08.371660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:08.504008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:08.513305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4c0b96df-95a2-42e7-a587-c3f0f4dc0ef2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153908 Jul 29 06:50:08.513868 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1292/2548] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:08 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:09.262470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:09.263067 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:09.269511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:09.269965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:09.270723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:09.271162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:09.398917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:09.406985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c6958e65-1d00-4bfc-b695-82da9afc6642 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148563 Jul 29 06:50:09.407545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1257/2549] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:09.535493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:09.536055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:09.543585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:09.544035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:09.544818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:09.545252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:09.674499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:09.682971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8363e24d-4916-4180-9151-e1e2389c451f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151408 Jul 29 06:50:09.683520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1293/2550] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:10.428731 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:10.429352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:10.436494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:10.436976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:10.437729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:10.438167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:10.565856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:10.574544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-486d9a10-7a35-4ca0-80e5-86da63a20320 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149821 Jul 29 06:50:10.575105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1258/2551] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:10.703114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:10.703664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:10.710219 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:10.710669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:10.711502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:10.711985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:10.840914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:10.849034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e519498d-8eea-4c87-8730-96e452b1f19f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149733 Jul 29 06:50:10.849627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1294/2552] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:11.595269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:11.595866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:11.603008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:11.603458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:11.604221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:11.604690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:11.733036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:11.741064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e3db7653-9401-46dc-b65b-5e111a336b97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149639 Jul 29 06:50:11.741626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1259/2553] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:11.871538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:11.872066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:11.878561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:11.879008 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:11.879764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:11.880193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:12.006447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:12.014607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7a73e0c4-933e-4bf4-9c86-f8e89ec87944 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147109 Jul 29 06:50:12.015223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1295/2554] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:11 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:12.763147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:12.763751 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:12.770320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:12.770771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:12.771516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:12.771950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:12.897206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:12.905432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-57cac982-ad77-4386-bc6b-62f58d0fed62 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146106 Jul 29 06:50:12.905984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1260/2555] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:13.036190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:13.036823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:13.043875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:13.044320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:13.045110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:13.045539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:13.174999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:13.183580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-23ac9f31-2ae1-4716-9e82-768a95d7565d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151220 Jul 29 06:50:13.184138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1296/2556] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:13 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:13.926195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:13.926802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:13.933484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:13.933926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:13.934675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:13.935106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:14.063397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:14.071802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9924525a-2398-4681-be5e-b6f572ff4977 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149447 Jul 29 06:50:14.072370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1261/2557] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:14.204736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:14.205344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:14.211783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:14.212224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:14.213263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:14.213695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:14.340785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:14.348690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d04eb15e-0db1-4fd3-a0c2-8ba91b8b9b23 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147788 Jul 29 06:50:14.349258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1297/2558] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:14 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:15.093054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:15.093655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:15.100026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:15.100473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:15.101262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:15.101693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:15.228926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:15.236666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ceef0918-b880-4ac6-8a52-f998cc73b6cf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147481 Jul 29 06:50:15.237221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1262/2559] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:15 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:15.370980 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:15.371518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:15.378018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:15.378469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:15.379229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:15.379668 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:15.505192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:15.513038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e6b531d9-be0b-4eff-bdf3-cd8cea668f43 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146877 Jul 29 06:50:15.513592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1298/2560] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:15 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:16.258358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:16.258929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:16.265330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:16.265784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:16.266545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:16.266986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:16.395207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:16.403895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d0750e85-0cb9-4e71-9472-03f9d2e0e858 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149575 Jul 29 06:50:16.404460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1263/2561] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:16.534035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:16.534607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:16.541835 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:16.542283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:16.543037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:16.543473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:16.673422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:16.681397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-190fe24e-bb71-49b4-bb92-7491be42f823 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151383 Jul 29 06:50:16.681939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1299/2562] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:17.426049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:17.426768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:17.433369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:17.433813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:17.434567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:17.434997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:17.560890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:17.568713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2dbc1d37-59df-4f46-94c6-56ef035a18df tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146561 Jul 29 06:50:17.569272 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1264/2563] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:17.703041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:17.703631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:17.710041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:17.710488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:17.712394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:17.713122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:17.842684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:17.844889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:17.851644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-335f0555-e5e4-47fa-abe3-89cd40732663 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152568 Jul 29 06:50:17.852318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1300/2564] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:17 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:18.591437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:18.592103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:18.598570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:18.599018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:18.599765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:18.600196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:18.603376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:18.729781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:18.737870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ae51d5b2-b88e-4816-995f-dbf3ea84af97 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150506 Jul 29 06:50:18.738430 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1265/2565] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:18.872302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:18.872945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:18.879444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:18.879892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:18.880677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:18.881116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:19.011943 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:19.019768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c131050a-66dc-4788-a29d-166fc3d24be5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151391 Jul 29 06:50:19.020326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1301/2566] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:18 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:19.759068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:19.759684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:19.766279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:19.766730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:19.767492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:19.767933 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:19.893734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:19.901556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-91ae94c7-6b43-4891-af7d-9773ff5b8963 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146686 Jul 29 06:50:19.902116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1266/2567] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:20.041870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:20.042608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:20.049141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:20.049596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:20.050346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:20.050783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:20.177897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:20.186191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d4ffeb52-336c-4b07-ac91-407309dafda0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148710 Jul 29 06:50:20.186804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1302/2568] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:20 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:20.922997 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:20.923608 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:20.930869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:20.931252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:20.932017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:20.932459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:21.057850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:21.065804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-54cbeb32-142c-430b-9c38-c87a1df1df53 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146683 Jul 29 06:50:21.066367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1267/2569] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:21.207116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:21.207731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:21.214736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:21.215187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:21.215937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:21.216375 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:21.345550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:21.357208 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-04811aba-425e-42d4-bc55-2b01b37fada7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153853 Jul 29 06:50:21.357772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1303/2570] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:21 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:22.087524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:22.088386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:22.094820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:22.095263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:22.096010 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:22.096440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:22.230492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:22.238364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca52b7fa-ad15-4740-a937-c02d2189eb5c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154774 Jul 29 06:50:22.238929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1268/2571] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:22 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:22.379233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:22.379852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:22.386566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:22.387022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:22.387785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:22.388222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:22.518343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:22.526805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-21a0bb88-7070-4d6f-864d-ca8418001159 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151477 Jul 29 06:50:22.527362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1304/2572] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:22 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:23.260649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:23.261187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:23.267646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:23.268091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:23.268880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:23.269314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:23.548144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:23.548727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:23.556210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:23.556688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:23.557472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:23.558213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:23.559840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:23.568051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a71f2fda-d880-4c97-9065-b5f223c71d26 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.311365 Jul 29 06:50:23.568651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1269/2573] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:23.699454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:23.712721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-adc793fc-0356-49a9-baa4-c9fd4e288aa1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.168182 Jul 29 06:50:23.713556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1305/2574] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:23 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:24.590599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:24.591241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:24.597394 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:24.597851 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:24.598611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:24.599051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:24.729754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:24.735421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:24.736137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:24.737976 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a38ec090-037b-47ea-a587-3bb1a4a534b9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152017 Jul 29 06:50:24.738539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1270/2575] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:24.743643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:24.744167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:24.745035 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:24.745544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:24.875529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:24.883918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8865956c-9dc9-4424-b4b0-9cf01dc79606 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152518 Jul 29 06:50:24.884479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1306/2576] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:24 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:25.759817 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:25.760720 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:25.768812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:25.769262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:25.770016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:25.770450 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:25.896089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:25.904222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fb7c710d-c7a5-433a-b3b3-eed4e160e32d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148981 Jul 29 06:50:25.904819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1271/2577] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:25.905067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:25.905680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:25.912073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:25.912518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:25.913300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:25.913731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:26.042037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:26.049893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-859da5c9-8bed-4d3e-9368-2883a68d2771 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148645 Jul 29 06:50:26.050450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1307/2578] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:25 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:26.926623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:26.927171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:26.934345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:26.934802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:26.935563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:26.936004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:27.061896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:27.069926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-59c93162-a22d-494d-9c7a-ba804e24725d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147282 Jul 29 06:50:27.071139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1272/2579] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:27.073639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:27.074394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:27.081778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:27.082254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:27.083024 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:27.083465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:27.212735 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:27.221076 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-28436bdb-05f6-498b-9328-023d4c351915 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153137 Jul 29 06:50:27.221629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1308/2580] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:27 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:28.092276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:28.092906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:28.099325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:28.099771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:28.100517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:28.100977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:28.229825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:28.237714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1f019edf-b2d8-4b04-99fa-ace939b34052 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149513 Jul 29 06:50:28.238266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1273/2581] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:28 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:28.242675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:28.243300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:28.250114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:28.250533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:28.251318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:28.251752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:28.376084 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:28.384683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-47a2b85d-f3c4-4d02-a7e8-a3a337592d4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145876 Jul 29 06:50:28.385242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1309/2582] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:28 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:29.259227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:29.259886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:29.266370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:29.266815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:29.267565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:29.267996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:29.393757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:29.402819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1e79be60-edb8-4bb4-9efd-c90a24a45900 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147611 Jul 29 06:50:29.403371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1274/2583] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:29 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:29.405615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:29.406234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:29.412874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:29.413335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:29.414751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:29.415209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:29.542267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:29.550280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-72656ed5-746c-4470-938a-f1fafdc18e8b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148557 Jul 29 06:50:29.550842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1310/2584] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:29 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:30.425042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:30.425651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:30.432892 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:30.433345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:30.434107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:30.434547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:30.564943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:30.571195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:30.571822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:30.573365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d9ffaa0c-b259-48eb-8765-df8bc7b7a3d6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152107 Jul 29 06:50:30.573928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1275/2585] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:30 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:30.578264 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:30.578715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:30.579478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:30.579917 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:30.710533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:30.719373 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9af520fc-c4e5-42d3-8f04-9d77717fd92b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152118 Jul 29 06:50:30.719941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1311/2586] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:30 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:31.594809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:31.595416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:31.602880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:31.603330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:31.604076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:31.604505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:31.731385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:31.739475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a0f7388f-aa14-4c6f-a81e-d7d6187d6cd1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148583 Jul 29 06:50:31.740023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1276/2587] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:31 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:31.740987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:31.741603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:31.748321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:31.748810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:31.749567 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:31.749998 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:31.876931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:31.885229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dce59e6d-9349-46cf-8b8f-1a965850d14a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148065 Jul 29 06:50:31.885786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1312/2588] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:31 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:32.763662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:32.764277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:32.770898 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:32.771350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:32.772107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:32.772556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:32.907386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:32.907925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:32.910769 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:32.914702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:32.915157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:32.915932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:32.916428 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:32.919055 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3aac65c4-804e-4528-96b7-985047235a9e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.159196 Jul 29 06:50:32.921341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1277/2589] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:32 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:33.054074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:33.062822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dffedda5-98f2-4553-8770-f32ca6e85a8a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.159395 Jul 29 06:50:33.063762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1313/2590] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:32 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:33.941420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:33.942036 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:33.949221 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:33.949677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:33.950446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:33.950889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:34.076641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:34.084588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b0d37d82-c5a2-4dd2-9206-a84afcfd8f9a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146971 Jul 29 06:50:34.084766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:34.085249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:34.085351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1278/2591] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:33 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:34.093222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:34.093667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:34.094426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:34.094867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:34.222345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:34.230251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-042bb9e6-4ac4-4f29-a398-a69fe8508da4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149387 Jul 29 06:50:34.230804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1314/2592] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:34 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:35.106568 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:35.107198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:35.109594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=52 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:35.114912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:35.115364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:35.116122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:35.116581 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:35.243677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:35.251116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:35.251641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-05dd7398-4348-43fe-9f4f-ef681bd8f648 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148824 Jul 29 06:50:35.251892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:35.252120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1279/2593] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:35 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:35.259284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:35.259737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:35.260507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:35.260974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:35.386722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:35.394524 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9e429b19-ba95-4d37-a52e-ed3b41a0d2b8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147209 Jul 29 06:50:35.395082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1315/2594] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:35 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:36.274655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:36.275205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:36.281691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:36.282150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:36.282912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:36.283352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:36.416360 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:36.417085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:36.418183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:36.419633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=54 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:36.425206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:36.425660 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:36.426314 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9d61ac11-85f7-432e-8ff0-ffe7a685d268 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156478 Jul 29 06:50:36.426449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:36.426887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1280/2595] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:36 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:36.427031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:36.559574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:36.567450 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0229caf9-3733-4605-bd54-ca115e9407af tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.155324 Jul 29 06:50:36.568010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1316/2596] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:36 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:37.447919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:37.448528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:37.455100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:37.455550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:37.456304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:37.456776 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:37.586540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:37.588990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:37.589910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:37.590635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:37.596120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9272e4b7-8fcb-452c-a768-17a2aeab1e7b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152324 Jul 29 06:50:37.596714 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1281/2597] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:37 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:37.597042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:37.597496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:37.598259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:37.598693 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:37.614354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:37.727965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:37.736021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1f65f018-c522-41e8-8dba-73bf2641ae94 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150737 Jul 29 06:50:37.736674 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1317/2598] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:37 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:38.619145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:38.619738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:38.626286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:38.626736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:38.627488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:38.627923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:38.756562 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:38.757199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:38.761635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:38.764059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:38.764520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:38.765323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:38.765767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:38.769785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f5be1839-a2ab-4b9f-a91d-d827ef3afdb2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155097 Jul 29 06:50:38.770352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1282/2599] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:38 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:38.895533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:38.903608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d5d6963-98b7-4a96-bc54-9b42b96d6fb7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150950 Jul 29 06:50:38.904170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1318/2600] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:38 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:39.791677 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:39.792277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:39.798785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:39.799240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:39.799996 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:39.800436 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:39.924878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:39.925601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:39.927670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:39.932815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:39.933268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:39.934026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:39.934460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:39.936405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b2013fe-ab1c-464c-b5ff-f5c87e9235d9 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149025 Jul 29 06:50:39.937233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1283/2601] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:39 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:40.061495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:40.069363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a43064a9-89ea-4fcb-95eb-38d3df652641 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148430 Jul 29 06:50:40.069995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1319/2602] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:39 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:40.958645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:40.959250 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:40.966499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:40.966945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:40.967695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:40.968127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:41.090976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:41.091681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:41.093533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:41.098449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:41.098897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:41.099658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:41.100090 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:41.101695 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3c34103c-8771-42ce-a680-649ec0f01698 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146843 Jul 29 06:50:41.102274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1284/2603] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:40 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:41.230649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:41.238580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d3de0286-80b0-4723-9e28-91e1713ff1de tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151679 Jul 29 06:50:41.239152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1320/2604] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:41 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:42.122811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:42.123426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:42.130071 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:42.130526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:42.131284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:42.131724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:42.260793 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:42.261434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:42.262948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:42.268040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:42.268502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:42.269301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:42.269746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:42.271360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-011619a7-71d5-4abb-957c-0015def49df8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152306 Jul 29 06:50:42.271944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1285/2605] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:42 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:42.399037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:42.406907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fa4f76da-b5d9-437d-862f-0ee1ec0a5ad7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150848 Jul 29 06:50:42.407499 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1321/2606] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:42 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:43.294087 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:43.294706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:43.301236 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:43.301687 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:43.302443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:43.302877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:43.427534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:43.428131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:43.433563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:43.435550 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:43.436040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:43.436983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:43.437427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:43.442022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e18171bc-3d43-4447-8cd7-9b463f152231 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151889 Jul 29 06:50:43.442596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1286/2607] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:43 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:43.565938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:43.574576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-46a26152-4a0b-4526-85d0-89187546e7e9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150835 Jul 29 06:50:43.575142 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1322/2608] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:43 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:44.464528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:44.465167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:44.471587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:44.472033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:44.472812 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:44.473243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:44.595329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:44.595982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:44.602722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:44.603197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:44.603968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:44.604401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:44.605475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:44.613596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-212cdea8-ec21-4ca5-b946-8c261b559033 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154176 Jul 29 06:50:44.614167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1287/2609] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:44 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:44.741166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:44.749818 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0aa0b8b0-92a7-4f92-b166-1a382191fc22 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.158391 Jul 29 06:50:44.750382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1323/2610] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:44 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:45.691305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:45.691925 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:45.699022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:45.699477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:45.700233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:45.700699 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:45.771050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:45.771667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:45.778319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:45.778771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:45.779541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:45.779981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:45.831069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:45.839254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-257567af-15a1-4c78-9609-518d5e0f7b54 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151888 Jul 29 06:50:45.839823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1288/2611] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:45 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:45.909309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:45.917346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-02d378c2-9f6a-40ba-88e4-47037c089218 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150171 Jul 29 06:50:45.917915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1324/2612] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:45 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:46.860453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:46.861100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:46.868163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:46.868642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:46.869404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:46.869846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:46.939348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:46.939949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:46.946928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:46.947385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:46.948168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:46.948634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:47.001085 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:47.010186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4935f45d-83bf-42c1-8299-e3723a2453ec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153520 Jul 29 06:50:47.010765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1289/2613] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:46 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:47.078552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:47.087326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0b25e677-b098-44db-b86d-abba813190e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151900 Jul 29 06:50:47.088152 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1325/2614] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:46 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:48.031115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:48.031725 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:48.038203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:48.038665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:48.039414 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:48.039846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:48.108447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:48.109104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:48.115644 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:48.116101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:48.116932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:48.117486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:48.169102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:48.177044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-74a37ad6-1060-4d4b-869c-29a875e081ba tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149741 Jul 29 06:50:48.177609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1290/2615] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:48 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:48.245920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:48.253915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e57b6428-3317-4161-a66a-7f2880abd45c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149346 Jul 29 06:50:48.254479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1326/2616] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:48 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:49.198280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:49.198888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:49.205311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:49.205762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:49.206517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:49.206953 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:49.275301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:49.276015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:49.282495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:49.282945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:49.283709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:49.284305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:49.337676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:49.345967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-30a53176-80bb-45a7-ad30-d32e95ae3082 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152102 Jul 29 06:50:49.346841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1291/2617] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:49 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:49.422738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:49.430721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-add70c63-1453-450b-a762-b3de63e9ce18 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.159235 Jul 29 06:50:49.431286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1327/2618] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:49 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:50.368210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:50.368855 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:50.375329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:50.375775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:50.376523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:50.376979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:50.451981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:50.452721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:50.459186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:50.459650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:50.460638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:50.461085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:50.510348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:50.518397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0d4543af-1622-4404-9582-aa9c3f871939 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.154765 Jul 29 06:50:50.518965 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1292/2619] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:50 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:50.592888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:50.601378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6e9a43d4-a49f-4de5-b1f8-363b906e021a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152606 Jul 29 06:50:50.602028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1328/2620] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:50 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:51.540690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:51.541345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:51.547768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:51.548220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:51.549018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:51.549464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:51.622869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:51.623492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:51.629829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:51.630282 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:51.631048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:51.631490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:51.681479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:51.689304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-48ecb5d9-ac9b-4dbe-94f8-86df514a542c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153245 Jul 29 06:50:51.689867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1293/2621] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:51 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:51.766935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:51.775551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b2637e6e-cba2-49a9-b9d4-35684a162fde tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156624 Jul 29 06:50:51.776119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1329/2622] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:51 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:52.710792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:52.711413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:52.718365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:52.718823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:52.719590 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:52.720031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:52.797323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:52.797865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:52.806952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:52.807408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:52.808185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:52.808650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:52.859902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:52.868630 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bd7a2311-304c-4b23-abe6-121b5677a5cc tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.161837 Jul 29 06:50:52.869191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1294/2623] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:52 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:52.943170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:52.951107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-08460261-b303-4e80-aa54-e7aace8e95a1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.158022 Jul 29 06:50:52.951669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1330/2624] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:52 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:53.889936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:53.890547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:53.896605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:53.897068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:53.897945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:53.898409 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:53.973605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:53.974137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:53.980967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:53.981426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:53.982260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:53.982639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:54.026838 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:54.034563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c146bb70-0215-4995-8af9-2a9165d64ce1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148658 Jul 29 06:50:54.035124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1295/2625] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:53 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:54.109986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:54.118316 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0c441fee-47f6-4638-ac74-dcd4175ab339 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148786 Jul 29 06:50:54.118879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1331/2626] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:53 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:55.055810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:55.056352 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:55.062752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:55.063198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:55.063945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:55.064378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:55.139434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:55.140131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:55.146762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:55.147211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:55.148758 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:55.148982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:55.199303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:55.207334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1c11f9e8-ea15-4cac-a627-2e9e178065a1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155411 Jul 29 06:50:55.207984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1296/2627] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:55 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:55.373467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:55.381530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-de7b4f23-6b2f-4022-98d2-f4b1de77bf37 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.245869 Jul 29 06:50:55.383635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1332/2628] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:55 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:50:56.230214 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:56.230820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:56.237301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:56.237754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:56.238505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:56.238945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:56.367603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:56.375475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e1f840c6-bdc2-4436-b471-1da264c1fa07 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149822 Jul 29 06:50:56.376033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1297/2629] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:56 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:56.404359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:56.405004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:56.411487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:56.411932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:56.412714 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:56.413965 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:56.541787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:56.549650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-243bfec6-9f73-4bda-802a-a4c6c55d50ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149071 Jul 29 06:50:56.550215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1333/2630] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:56 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:57.396455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:57.397088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:57.404164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:57.404652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:57.405421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:57.405857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:57.420822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:57.534082 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:57.542704 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-95311269-5f50-4c75-959a-855dd316f71a tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150065 Jul 29 06:50:57.543273 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1298/2631] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:57 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:57.571898 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:57.572622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:57.579144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:57.579599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:57.580348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:57.580807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:57.583318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:50:57.709337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:57.718186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a7dd7a17-556b-4600-a566-3010e4f4631f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150912 Jul 29 06:50:57.718743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1334/2632] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:57 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:58.563181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:58.563821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:58.570296 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:58.570741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:58.571495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:58.571927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:58.700672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:58.708460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-75648409-b502-46ec-96f5-a6ae29bb79f6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149155 Jul 29 06:50:58.709047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1299/2633] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:58 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:58.741005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:58.741653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:58.748395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:58.748878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:58.749639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:58.750078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:58.875736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:58.883731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d87ec71-3d7d-4197-820d-7f5381c97e2d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146522 Jul 29 06:50:58.884296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1335/2634] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:58 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:59.731266 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:59.731901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:59.738379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:59.738825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:59.739575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:59.740006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:59.866863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:50:59.875197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5818cee3-ea91-41ec-b30e-32474e254ee5 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.147976 Jul 29 06:50:59.875755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1300/2635] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:59 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:50:59.904842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:50:59.905487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:50:59.912059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:59.912598 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:50:59.913370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:50:59.914313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:00.047271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:00.055993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-70b73e94-5f12-49f5-b3f8-4f6439884363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.155091 Jul 29 06:51:00.056561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1336/2636] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:50:59 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:00.895080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:00.895691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:00.901973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:00.902422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:00.903167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:00.903598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:01.034512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:01.043019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e439aed3-086f-46f6-be93-9cacda95ecaf tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151754 Jul 29 06:51:01.043577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1301/2637] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:00 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:01.076894 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:01.077514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:01.083996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:01.084453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:01.085247 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:01.086280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:01.214781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:01.222678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6e75ee01-f6cf-4aa3-8190-b8c2b6b45081 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149692 Jul 29 06:51:01.223228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1337/2638] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:01 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:02.063905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:02.064557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:02.071468 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:02.071985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:02.072795 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:02.073230 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:02.198698 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:02.206476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-43331e67-4d7a-47c8-bca0-3db63fb46c2b tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146405 Jul 29 06:51:02.207035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1302/2639] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:02 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:02.243155 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:02.243790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:02.250286 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:02.250737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:02.251492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:02.251930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:02.378036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:02.386403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e499b91e-9084-4574-8c69-cb2d3bbf0825 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147141 Jul 29 06:51:02.386957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1338/2640] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:02 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:03.228339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:03.228896 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:03.235443 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:03.235895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:03.236683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:03.237122 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:03.372847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:03.380736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9cd576c-c5c5-4a7a-ad9b-2a4fe62adbec tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156617 Jul 29 06:51:03.381300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1303/2641] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:03 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:03.407229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:03.407836 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:03.414372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:03.414817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:03.415569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:03.416005 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:03.547648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:03.556746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-82dd5463-d163-48d7-b26e-c23bd6d020d1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153255 Jul 29 06:51:03.557318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1339/2642] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:03 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:04.403034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:04.403651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:04.410213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:04.410671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:04.411435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:04.411876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:04.542655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:04.550557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b367820-6e2f-4dbc-bd21-afb5a00beee3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151455 Jul 29 06:51:04.551123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1304/2643] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:04 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:04.578838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:04.579461 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:04.585996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:04.586493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:04.587276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:04.587722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:04.716405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:04.724493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3f74bab2-3307-4d5e-b708-ca77130da88a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149397 Jul 29 06:51:04.725077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1340/2644] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:04 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:05.573234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:05.573844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:05.576146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=52 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:05.581679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:05.582157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:05.582908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:05.583341 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:05.711114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:05.719700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b9c504ce-6827-4d12-bee5-3bc59982fff8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.151181 Jul 29 06:51:05.720486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1305/2645] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:05 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:05.745810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:05.746422 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:05.752920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:05.753364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:05.754113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:05.754544 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:05.887795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:05.896222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59143b41-1da6-4b93-b404-651df0343ce4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154668 Jul 29 06:51:05.897097 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1341/2646] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:05 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:06.740315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:06.740963 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:06.747984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:06.748429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:06.749211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:06.749664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:06.880967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:06.889113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-59377ca1-a48b-4c82-bf21-0aeb06070433 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152600 Jul 29 06:51:06.889678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1306/2647] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:06 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:06.918923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:06.919542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:06.922006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=52 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:06.927404 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:06.927856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:06.928647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:06.929092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:07.057823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:07.065672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-77959361-08c0-4c53-85d5-fe97699e001f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151859 Jul 29 06:51:07.066241 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1342/2648] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:06 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:51:07.910141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:07.910738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:07.917887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:07.918371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:07.919131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:07.919571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:08.048797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:08.057081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7a2e071d-6015-4075-80df-e1f98ddb6848 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150828 Jul 29 06:51:08.057645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1307/2649] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:07 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:08.088471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:08.089108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:08.095521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:08.095968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:08.096757 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:08.097192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:08.223854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:08.231771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e9676b42-3b6e-4454-aeb4-80106bd88b5a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148258 Jul 29 06:51:08.232329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1343/2650] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:08 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:09.078666 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:09.079224 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:09.086326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:09.086787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:09.087588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:09.088290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:09.213478 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:09.221334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-35311c1a-9ad9-4f99-bb07-f011037c7da4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.146641 Jul 29 06:51:09.221902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1308/2651] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:09 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:09.253014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:09.253630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:09.260785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:09.261240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:09.261996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:09.262435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:09.391684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:09.400425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d3594310-0934-4fc7-902f-9802ae0e4e8f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151187 Jul 29 06:51:09.401020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1344/2652] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:10.243291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:10.243905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:10.250432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:10.250888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:10.251641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:10.252081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:10.383894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:10.391798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-613c3050-6d99-49f1-bc19-47039919b55e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153080 Jul 29 06:51:10.392361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1309/2653] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:10 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:10.421708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:10.422317 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:10.428788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:10.429267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:10.430136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:10.430576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:10.557933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:10.565816 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f9306c0b-f977-4874-899f-ca4461970e0c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147914 Jul 29 06:51:10.566374 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1345/2654] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:11.414123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:11.414733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:11.421283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:11.421743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:11.422492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:11.422931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:11.552270 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:11.560772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-83920110-85d6-4260-b28c-800eb629d1b1 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150571 Jul 29 06:51:11.561339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1310/2655] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:11 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:11.587169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:11.587796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:11.594737 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:11.595190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:11.595952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:11.596394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:11.727402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:11.735267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dcf9032c-4780-483d-82a0-89d4019fef7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151958 Jul 29 06:51:11.735831 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1346/2656] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:11 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:12.582360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:12.582971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:12.590131 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:12.590579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:12.591382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:12.591820 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:12.726190 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:12.734850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d1b1c229-a5be-4a38-8343-c7bf94c7e7e7 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.156291 Jul 29 06:51:12.735416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1311/2657] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:12 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:12.756083 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:12.756771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:12.763217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:12.763662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:12.764409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:12.764873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:12.896192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:12.904775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4727e110-3bc3-4e84-a230-c84057ab4dbc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152490 Jul 29 06:51:12.905341 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1347/2658] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:12 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:13.756889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:13.757561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:13.764954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:13.765402 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:13.766152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:13.766587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:13.894274 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:13.902181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5e7d863a-f09b-4dd0-8798-bfc0a6d58da3 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149137 Jul 29 06:51:13.902741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1312/2659] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:13 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:13.925547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:13.926161 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:13.933194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:13.933640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:13.934390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:13.934824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:14.059942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:14.067729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d241828-31ff-44fb-88d4-07cab711e1cd tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146005 Jul 29 06:51:14.068283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1348/2660] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:13 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:14.923552 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:14.924164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:14.930935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:14.931396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:14.932157 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:14.932619 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:15.063926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:15.072564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3c653b18-fd56-4f30-867a-4a201e72427c tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152930 Jul 29 06:51:15.073130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1313/2661] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:14 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:15.088986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:15.089593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:15.096445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:15.096923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:15.097680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:15.098114 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:15.231411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:15.239319 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-288c4551-c1ed-44cb-86a8-8478c86313d3 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154471 Jul 29 06:51:15.239888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1349/2662] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:15 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:16.094162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:16.094803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:16.101904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:16.102359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:16.103134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:16.103566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:16.232641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:16.240979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2e5bf99a-a29d-44e3-8967-646d6eba881f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.150609 Jul 29 06:51:16.241606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1314/2663] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:16 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:16.260303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:16.260955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:16.267431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:16.267887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:16.268676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:16.269118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:16.396149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:16.399087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:16.406187 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f8def331-6944-40e7-9214-39e8f7fe2879 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149742 Jul 29 06:51:16.406752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1350/2664] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:17.263410 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:17.264016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:17.270472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:17.270919 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:17.271663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:17.272096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:17.274729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:17.400786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:17.409094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ee7295ae-26f2-404a-a343-84a593e405a6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149542 Jul 29 06:51:17.409670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1315/2665] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:17 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:17.427124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:17.427739 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:17.434981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:17.435433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:17.436201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:17.436677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:17.574224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:17.582138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1ee9f2e5-a2a8-4378-a746-eaa8b9beecec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.158837 Jul 29 06:51:17.582689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1351/2666] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:17 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:18.431170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:18.431773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:18.438471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:18.438923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:18.439684 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:18.440119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:18.573171 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:18.581132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c45b742f-851d-4b23-9bc4-898a2ab3400f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.153871 Jul 29 06:51:18.581691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1316/2667] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:18 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:18.604382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:18.605102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:18.611615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:18.612068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:18.612865 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:18.613305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:18.742067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:18.750043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-012732cb-4fd3-43f3-bafb-c0709f6fd982 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150130 Jul 29 06:51:18.750639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1352/2668] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:18 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:19.603604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:19.604246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:19.610928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:19.611380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:19.612140 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:19.612603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:19.739399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:19.748596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a9974eac-cafa-4bf0-977d-e53c53fbd89d tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149423 Jul 29 06:51:19.749164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1317/2669] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:19 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:19.771116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:19.771824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:19.778480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:19.778927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:19.779686 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:19.780124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:19.908655 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:19.916459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f05d7059-e485-4479-9b5d-5c805aa267f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149200 Jul 29 06:51:19.917079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1353/2670] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:19 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:20.770721 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:20.771334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:20.778384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:20.778829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:20.779577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:20.780007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:20.911455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:20.919246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3228e226-789f-4cd8-be04-372389452f3f tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.152609 Jul 29 06:51:20.919813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1318/2671] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:20 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:20.938201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:20.938814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:20.945852 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:20.946315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:20.947073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:20.947512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:21.074189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:21.081988 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-14392e83-a967-4fea-82a4-c73385be0a53 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147791 Jul 29 06:51:21.082542 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1354/2672] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:20 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:21.939763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:21.940373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:21.947496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:21.947945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:21.948736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:21.949168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:22.076095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:22.084285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1268d5bf-f799-4ffa-b51c-780ec5df0df4 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148329 Jul 29 06:51:22.084882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1319/2673] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:21 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:22.103031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:22.103646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:22.110104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:22.110580 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:22.111347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:22.111780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:22.236772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:22.246080 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a0b86f33-8722-42c7-b44f-34c6976e2317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146833 Jul 29 06:51:22.246654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1355/2674] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:22 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:23.106162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:23.106773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:23.113441 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:23.113889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:23.114637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:23.115069 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:23.244126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:23.251813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4b86a78d-74fa-4121-8d5a-d70d26639c67 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.149491 Jul 29 06:51:23.252373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1320/2675] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:23 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:23.268055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:23.268709 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:23.275321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:23.275776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:23.276625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:23.277014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:23.407157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:23.415688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aeed343e-c6f8-4724-a937-62ea905ec26e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151477 Jul 29 06:51:23.416251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1356/2676] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:23 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:24.275789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:24.276863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:24.284039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:24.284565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:24.285350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:24.285785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:24.424049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:24.433588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8190daed-b777-43cb-b96a-a12f02e7af09 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.164367 Jul 29 06:51:24.434164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1321/2677] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:24 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:24.440821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:24.440821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:24.447275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:24.448014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:24.449363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:24.450111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:24.592971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:24.602101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1e4d66e0-a6ae-412a-a3fe-19f526eb8c40 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.169313 Jul 29 06:51:24.602687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1357/2678] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:24 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:51:25.455594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:25.456199 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:25.463653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:25.464105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:25.464891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:25.465331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:25.591975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:25.600064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bab2757c-1bb8-4717-969f-bcedea418ea0 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.148436 Jul 29 06:51:25.600649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1322/2679] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:25 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:25.626266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:25.626877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:25.633874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:25.634322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:25.635070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:25.635503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:25.765350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:25.773625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b3b06591-94bc-4f61-9702-1e7560dd1a14 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150754 Jul 29 06:51:25.774190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1358/2680] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:25 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:26.622309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:26.622877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: e3c6cd3c-a26a-45fe-b507-9594b994002c] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:26.629454 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:26.629908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:26.630667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:26.631127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:26.765516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:26.773473 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5063f86c-2357-4bfd-a745-555e08425e0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c" status: 200 len: 1735 microversion: 2.1 time: 0.155104 Jul 29 06:51:26.774020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1323/2681] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:26 2022] GET /compute/v2.1/servers/e3c6cd3c-a26a-45fe-b507-9594b994002c => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:26.794123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:26.794332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef9190d3-49f5-4746-947e-a972b86f49b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '.version_select at 0x7f1459ade5e0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:26.794811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:26.800852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:26.801304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:26.802070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:26.802505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:26.814996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef9190d3-49f5-4746-947e-a972b86f49b2 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146381832" status: 202 len: 0 microversion: 2.1 time: 0.024374 Jul 29 06:51:26.815565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1359/2682] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Jul 29 06:51:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1146381832 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:51:26.939520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:26.947987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a33c9105-b337-4de7-9acd-3659e69c685f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.157402 Jul 29 06:51:26.948727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1324/2683] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:26 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:51:27.970553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:27.971112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:27.977819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:27.978277 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:27.979048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:27.979505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:28.248492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:28.256414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-84495c68-7ba8-471e-bf01-79b2a0dc43fe tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.290381 Jul 29 06:51:28.257121 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1360/2684] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:27 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:28.360856 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-d6fe2c4f-57b1-40d5-8e01-caf674914176 req-0e92e107-a069-4e0b-815b-011d62a9a89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c6cd3c-a26a-45fe-b507-9594b994002c", "name": "network-vif-deleted", "tag": "0d3eecc6-30a2-46cd-95ea-608f50908f78"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:51:28.374874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-d6fe2c4f-57b1-40d5-8e01-caf674914176 req-0e92e107-a069-4e0b-815b-011d62a9a89a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:28.375434 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-d6fe2c4f-57b1-40d5-8e01-caf674914176 req-0e92e107-a069-4e0b-815b-011d62a9a89a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:28.388639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-d6fe2c4f-57b1-40d5-8e01-caf674914176 req-0e92e107-a069-4e0b-815b-011d62a9a89a service nova] Creating event network-vif-deleted:0d3eecc6-30a2-46cd-95ea-608f50908f78 for instance e3c6cd3c-a26a-45fe-b507-9594b994002c on hv-cinder-83482 Jul 29 06:51:28.393880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-d6fe2c4f-57b1-40d5-8e01-caf674914176 req-0e92e107-a069-4e0b-815b-011d62a9a89a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 Jul 29 06:51:28.394479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1325/2685] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:51:29.279657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:29.280269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:29.286752 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:29.287197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:29.287945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:29.288387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:29.457186 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:29.465957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cb993f06-fd18-4f17-8270-d13b5ebecf15 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.190415 Jul 29 06:51:29.466526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1361/2686] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:29 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:30.488406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:30.489160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:30.496670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:30.497129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:30.497894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:30.498333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:30.671559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:30.679962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d58ccc05-f00f-4860-9068-ec46488e5d91 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.196210 Jul 29 06:51:30.680512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1326/2687] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:30 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:31.701487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:31.702094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:31.708599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:31.709048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:31.709798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:31.711042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:31.840048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:31.847947 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-356590b6-fadc-464c-b938-b81d92062674 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150323 Jul 29 06:51:31.848510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1362/2688] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:31 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:32.870134 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:32.870747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:32.877245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:32.877694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:32.878453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:32.878889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:33.010043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:33.017968 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b2f693a9-8cdd-4588-a588-74ef4ef16102 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152491 Jul 29 06:51:33.018544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1327/2689] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:32 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:34.039321 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:34.040004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:34.046514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:34.046967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:34.047719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:34.048153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:34.175289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:34.184050 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ccf60ed9-805c-4fcd-a867-177fb2d37279 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148689 Jul 29 06:51:34.184617 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1363/2690] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:34 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:35.205788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:35.206392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:35.213404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:35.213835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:35.214589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:35.215021 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:35.342861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:35.351232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9990b495-27f6-40d0-b79e-7d99eaff3fa2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148813 Jul 29 06:51:35.351791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1328/2691] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:35 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:36.373028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:36.373640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:36.380250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:36.380732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:36.381487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:36.382619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:36.511495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:36.519399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e8e136d5-31cb-4164-8dd0-3df3097a9c0a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150232 Jul 29 06:51:36.519949 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1364/2692] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:36 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:37.541044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:37.541694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:37.544133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=48 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:37.549492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:37.549971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:37.550729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:37.551164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:37.682298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:37.690286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-869e2f57-a843-4124-9c85-615560df041c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153980 Jul 29 06:51:37.690857 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1329/2693] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:37 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:38.711721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:38.712313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:38.714854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:38.720279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:38.720761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:38.721520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:38.721956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:38.853026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:38.860974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8d299229-0cbf-44b6-bfe1-7d37f2b2c8f5 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153608 Jul 29 06:51:38.861533 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1365/2694] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:38 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:39.882211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:39.882835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:39.889330 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:39.889785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:39.890541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:39.890982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:40.017185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:40.025665 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b5dafd31-c834-4c54-a047-7ccb649c866d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147948 Jul 29 06:51:40.026222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1330/2695] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:39 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:41.046955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:41.047577 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:41.054627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:41.055082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:41.055846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:41.056289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:41.182503 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:41.190475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cc10b4e9-b9fd-47c3-b82b-fea92fcc2b4c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147398 Jul 29 06:51:41.191036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1366/2696] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:41 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:42.212358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:42.213262 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:42.219674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:42.220130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:42.220926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:42.221368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:42.350102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:42.358554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8cf384e8-5f40-4aef-8b0a-17ca63eabc4d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150987 Jul 29 06:51:42.359118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1331/2697] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:42 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:43.380466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:43.381102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:43.388169 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:43.388637 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:43.389393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:43.389827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:43.520514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:43.529259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-872a4a6f-d0f2-42db-9e0d-e0d474ab00bb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152681 Jul 29 06:51:43.529811 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1367/2698] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:43 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:44.550931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:44.551554 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:44.558825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:44.559284 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:44.560047 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:44.560489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:44.575654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=100 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:44.688144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:44.696547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f58d827d-f33c-4363-9b28-ab643cecf37b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149487 Jul 29 06:51:44.697111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1332/2699] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:44 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:45.718569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:45.719196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:45.726824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:45.727265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:45.728037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:45.728477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:45.744171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=100 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:51:45.857972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:45.865850 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c42fe9dc-7608-448d-8ab2-783ab567a363 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151196 Jul 29 06:51:45.866532 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1368/2700] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:45 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:46.887408 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:46.887993 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:46.894917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:46.895362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:46.896109 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:46.896557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:47.021664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:47.029813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-56ed419f-93dc-4aa1-8c1d-5ac18bcbeb74 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146233 Jul 29 06:51:47.030385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1333/2701] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:46 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:48.051227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:48.051837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:48.058915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:48.059357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:48.060110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:48.060563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:48.188839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:48.197354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-485f1806-3105-4216-971d-32f82d8853bc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149988 Jul 29 06:51:48.197922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1369/2702] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:48 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:49.218867 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:49.219486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:49.226033 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:49.226549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:49.227849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:49.228288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:49.360232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:49.369053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c675bde9-7bf0-4c75-a546-ec7240e742fa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154040 Jul 29 06:51:49.369627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1334/2703] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:49 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:50.391786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:50.392409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:50.399914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:50.400795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:50.401629 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:50.402070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:50.530649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:50.538535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dc61936a-13f3-4385-8a37-29e96168290f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152098 Jul 29 06:51:50.539732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1370/2704] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:50 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:51.559926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:51.560532 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:51.566936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:51.567381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:51.568128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:51.568576 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:51.695723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:51.704432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1c4e6f3b-86a3-4fa0-96fe-53b62f1d31f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148403 Jul 29 06:51:51.705013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1335/2705] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:51 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:52.726684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:52.727437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:52.734109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:52.734555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:52.735305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:52.735746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:52.869995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:52.877814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cf7fe748-2542-497d-9ac9-3fc7e0fb9e25 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.155191 Jul 29 06:51:52.878372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1371/2706] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:52 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:53.899506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:53.900124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:53.906186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:53.906631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:53.907380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:53.907809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:54.035309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:54.044181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-abed2961-830b-4c8f-b0ba-0255476f1891 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148767 Jul 29 06:51:54.044780 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1336/2707] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:53 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:55.066246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:55.066774 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:55.074281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:55.074736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:55.075493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:55.075930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:55.203624 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:55.211556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d3641eb1-caf2-4c64-880b-4a1f0353e9ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149338 Jul 29 06:51:55.212437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1372/2708] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:55 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:56.233257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:56.233868 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:56.240613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:56.241063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:56.241821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:56.242255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:56.367865 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:56.375745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-35c59f26-fcc2-467a-bb30-f9bbfca65317 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146379 Jul 29 06:51:56.376304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1337/2709] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:56 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:57.397692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:57.398344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:57.405400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:57.405861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:57.406638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:57.407077 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:57.538467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:57.546707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-659a1969-a684-44e6-8da8-1bb2b87c44cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152960 Jul 29 06:51:57.547267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1373/2710] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:57 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:51:58.567263 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:58.567869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:58.575389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:58.575835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:58.576602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:58.577038 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:58.583854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:51:58.584329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:51:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:51:58.709717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:58.717764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9f5f6124-51c3-44f8-8a2e-7efa8410a540 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154391 Jul 29 06:51:58.718326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1338/2711] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:58 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:51:59.613475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:51:59.614189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:51:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:51:59.739199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:51:59.739847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:51:59.747337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:59.747784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:59.748566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:51:59.749002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:51:59.877237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:51:59.885149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d704e25-9553-4f19-8d08-ee9c550dd5ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149791 Jul 29 06:51:59.885711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1374/2712] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:51:59 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:00.906099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:00.906712 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:00.913338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:00.913814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:00.914702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:00.915143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:01.042002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:01.049986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-216a309b-3557-4d4e-852c-259491cfd7f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147734 Jul 29 06:52:01.050539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1339/2713] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:00 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:02.071991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:02.072641 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:02.079189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:02.079648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:02.080423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:02.080901 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:02.208263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:02.216603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-139f514d-31e2-42a4-8a17-6a13b4c76c60 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149068 Jul 29 06:52:02.217159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1375/2714] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:02 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:03.238530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:03.239145 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:03.245828 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:03.246285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:03.247043 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:03.247483 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:03.373939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:03.381849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7d4a916a-771f-421f-b424-dfbbb9d39a11 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147179 Jul 29 06:52:03.382406 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1340/2715] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:03 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:04.402743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:04.403354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:04.409826 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:04.410272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:04.411057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:04.411489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:04.540477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:04.548364 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-34740284-d400-4315-bbc4-4c64f9a1a6be tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149490 Jul 29 06:52:04.548982 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1376/2716] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:04 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:05.570323 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:05.571580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:05.578167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:05.578616 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:05.579369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:05.579805 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:05.710753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:05.718888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6102072b-14d7-43b0-874c-d21bd3152884 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152430 Jul 29 06:52:05.719446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1341/2717] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:05 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:06.739210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:06.739830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:06.746995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:06.747449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:06.748210 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:06.748683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:06.879615 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:06.888025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5d5acd7b-f84b-4e22-99cf-9c8b9d1a2c4a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152698 Jul 29 06:52:06.888592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1377/2718] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:06 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:07.911106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:07.911724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:07.914068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=26 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:07.920391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:07.920864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:07.921620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:07.922053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:08.048245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:08.056498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0b4ca761-de49-4449-bd03-4802748457ff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149286 Jul 29 06:52:08.057076 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1342/2719] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:07 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:09.076771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:09.077400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:09.079663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=26 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:09.085158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:09.085602 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:09.086367 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:09.086795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:09.217475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:09.225388 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-aa3df751-7126-44b1-ae8e-0bcd4d7cac7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152462 Jul 29 06:52:09.225959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1378/2720] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:10.247611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:10.248229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:10.254906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:10.255363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:10.256127 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:10.256588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:10.388264 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:10.396280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3e6c2eea-952c-4c43-8c2a-9fdb9951c5da tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152596 Jul 29 06:52:10.396877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1343/2721] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:52:11.417421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:11.418665 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:11.425350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:11.425796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:11.426546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:11.426979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:11.553768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:11.561796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4c199f6b-73ed-41bc-b82d-a2d9e183cedb tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148249 Jul 29 06:52:11.562354 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1379/2722] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:11 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:12.582215 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:12.582823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:12.589642 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:12.590088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:12.590836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:12.591269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:12.718840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:12.727486 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b81c450e-3b4d-4d06-a2f7-355c4448fa2f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148468 Jul 29 06:52:12.728424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1344/2723] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:12 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:13.748721 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:13.749333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:13.755729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:13.756173 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:13.756961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:13.757394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:13.888010 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:13.896018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a9b7de14-d490-4496-bb15-23b38419e584 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151223 Jul 29 06:52:13.896715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1380/2724] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:13 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:14.918261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:14.918863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:14.925593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:14.926034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:14.926775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:14.927205 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:14.931257 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=76 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:15.053470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:15.061726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-01fb21e4-1ac5-475e-9b54-0a1751b31ae6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147403 Jul 29 06:52:15.062288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1345/2725] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:14 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:16.083229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:16.083847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:16.091343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:16.091796 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:16.092581 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:16.093025 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:16.095559 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=76 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:16.219251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:16.227738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dc216bbf-8bb9-49a8-930c-7cdda53c7fa4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148327 Jul 29 06:52:16.228297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1381/2726] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:17.249063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:17.249661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:17.256242 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:17.256728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:17.257488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:17.258433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:17.386513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:17.394499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-477d9753-9071-4794-80c5-103752774d55 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149580 Jul 29 06:52:17.395065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1346/2727] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:17 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:18.418191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:18.418810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:18.425334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:18.425784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:18.426541 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:18.426979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:18.556421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:18.564350 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1b4bb055-1674-4cbe-9ddf-c893a6f33556 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150941 Jul 29 06:52:18.564967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1382/2728] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:18 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:19.586935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:19.587545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:19.594425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:19.594876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:19.595636 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:19.596072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:19.723376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:19.732380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-002e8e18-523a-477f-ad8b-b1aad6e47c35 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149863 Jul 29 06:52:19.732974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1347/2729] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:19 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:20.753861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:20.754480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:20.761650 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:20.762122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:20.762885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:20.763322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:20.894250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:20.902303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cd5ed03f-badd-4e4f-904b-760de56da6cc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152263 Jul 29 06:52:20.902861 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1383/2730] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:20 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:21.923895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:21.924526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:21.931317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:21.931761 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:21.932512 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:21.932972 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:22.064116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:22.072095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4dba2c7b-fa1d-46ee-ac26-5a5e0336e0d2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152079 Jul 29 06:52:22.072664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1348/2731] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:21 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:23.093390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:23.094003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:23.100627 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:23.101082 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:23.101891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:23.102347 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:23.227972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:23.236078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cb6c9611-1a85-49a0-af17-60f76873597a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146509 Jul 29 06:52:23.236645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1384/2732] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:23 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:24.257862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:24.258563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:24.265019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:24.265474 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:24.266281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:24.266726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:24.407915 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:24.417754 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b54d465-0635-44ff-9b8d-eaa4f2c87b7a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.163978 Jul 29 06:52:24.418734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1349/2733] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:24 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:25.440955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:25.441549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:25.448718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:25.449165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:25.449919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:25.450370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:25.580004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:25.587903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-340d32df-72c6-4d22-ae10-6e19d28e9a2e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150770 Jul 29 06:52:25.588750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1385/2734] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:25 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:26.609830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:26.610444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:26.617479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:26.618104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:26.618849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:26.619285 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:26.750169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:26.759303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dd2afee7-54ce-4516-b8e8-e8204c812cf9 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153423 Jul 29 06:52:26.759869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1350/2735] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:26 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:27.780353 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:27.780996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:27.787455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:27.787908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:27.789196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:27.789951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:27.918618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:27.926551 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-787bca2f-6e1a-47f9-bc25-9bdc5d5ce43c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150073 Jul 29 06:52:27.927109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1386/2736] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:27 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:28.948191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:28.948829 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:28.955223 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:28.955667 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:28.956412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:28.956876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:29.084613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:29.093320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9bb9c975-7654-48c0-bccc-5b91e6813898 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149225 Jul 29 06:52:29.093866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1351/2737] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:28 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:30.114658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:30.115296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:30.122538 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:30.122986 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:30.123738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:30.124174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:30.249928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:30.257854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e786ba04-ab2b-4ee4-81aa-3e1bf0bef74f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146987 Jul 29 06:52:30.258406 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1387/2738] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:30 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:31.283696 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:31.284311 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:31.291240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:31.291694 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:31.292440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:31.292902 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:31.417367 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:31.425189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-29e93e41-a616-45dd-afdb-8252f358e4f4 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145644 Jul 29 06:52:31.425736 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1352/2739] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:31 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:32.448276 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:32.448927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:32.455434 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:32.455883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:32.456675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:32.457110 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:32.586594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:32.594698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-278738eb-6fa2-4657-bf8a-886a2087615d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151383 Jul 29 06:52:32.595253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1388/2740] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:32 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:33.615333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:33.615942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:33.622613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:33.623057 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:33.623808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:33.624243 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:33.754872 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:33.770198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1eeebd01-ab1f-4bad-b558-9e0164c9ea0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153649 Jul 29 06:52:33.770198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1353/2741] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:33 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:34.786893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:34.787540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:34.794878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:34.795329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:34.796087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:34.796526 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:34.921565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:34.929663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-18f15c24-0ba5-4d2c-80ce-5f87c3851998 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146521 Jul 29 06:52:34.930222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1389/2742] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:34 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:35.952903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:35.953518 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:35.960060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:35.960561 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:35.961318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:35.961756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:36.088676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:36.096511 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-20cb6364-9e01-4a9e-8307-2a61a87f7a33 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147594 Jul 29 06:52:36.097088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1354/2743] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:35 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:37.116782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:37.117394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:37.124206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:37.124687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:37.125442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:37.125873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:37.256178 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:37.264764 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ef8821b3-14cf-4ea1-8f38-8efb3ce02a9a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151797 Jul 29 06:52:37.265349 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1390/2744] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:37 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:38.286815 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:38.287426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:38.290302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=26 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:38.295702 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:38.296152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:38.296938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:38.297380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:38.427859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:38.436327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7822dbcf-99da-4aa3-a113-b8d58b27e408 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.153434 Jul 29 06:52:38.436907 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1355/2745] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:38 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:39.458382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:39.459038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:39.461370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=26 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:39.467333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:39.467781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:39.468560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:39.469001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:39.596800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:39.605310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-18d29ec9-959b-44d1-ab84-0bb285d6c5b2 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150825 Jul 29 06:52:39.605874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1391/2746] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:39 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:40.627009 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:40.627605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:40.634690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:40.635139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:40.635891 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:40.636326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:40.764509 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:40.772292 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-138c3355-073a-4c46-93f4-83506097f10e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149300 Jul 29 06:52:40.772875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1356/2747] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:40 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:41.793935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:41.794554 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:41.801060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:41.801512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:41.802269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:41.802710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:41.932369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:41.940228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9f2d1a35-b60a-47f4-bbb5-706208af0cff tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150185 Jul 29 06:52:41.940805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1392/2748] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:41 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:42.962519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:42.963381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:42.970000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:42.970459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:42.971225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:42.971663 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:43.096387 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:43.104557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8c26337b-49f4-4c77-92fe-b12f3a6d0ed6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145983 Jul 29 06:52:43.105130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1357/2749] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:42 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:44.126372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:44.126989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:44.134616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:44.135070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:44.135827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:44.136266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:44.262191 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:44.270159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f2b9fc27-b43f-4ae0-bb6c-8917bfe6e1e8 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147719 Jul 29 06:52:44.270720 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1393/2750] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:44 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:45.291810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:45.292453 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:45.299068 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:45.299520 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:45.300271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:45.300746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:45.303240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=78 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:45.431467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:45.439271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e5d4788c-c365-49c5-a6d9-fe2746925b6e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151338 Jul 29 06:52:45.439836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1358/2751] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:45 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:46.460880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:46.461529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:46.468478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:46.468959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:46.469719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:46.470159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:46.472701 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=78 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:52:46.596648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:46.605148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-805f59ae-655a-4fc2-895b-ad0650b1905a tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148203 Jul 29 06:52:46.605706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1394/2752] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:46 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:47.626771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:47.627386 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:47.633889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:47.634335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:47.635083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:47.635516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:47.762858 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:47.770632 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cfc59141-7c39-4848-b044-fb35e6949800 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147691 Jul 29 06:52:47.771186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1359/2753] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:47 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:52:48.792067 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:48.792658 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:48.799180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:48.799634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:48.800400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:48.800875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:48.931126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:48.939107 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-09910763-c893-4e85-bb2a-eb54deca376f tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151757 Jul 29 06:52:48.939667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1395/2754] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:48 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:49.960701 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:49.961960 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:49.968612 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:49.969061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:49.969810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:49.970244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:50.100703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:50.108571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-22339101-494f-47ce-ba56-d7fb79a2352b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151803 Jul 29 06:52:50.109132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1360/2755] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:49 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:51.129469 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:51.130081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:51.136884 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:51.137339 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:51.138088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:51.138520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:51.266396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:51.274507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e10df40-ecaf-4db8-ac5d-ce66f91495ac tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148894 Jul 29 06:52:51.275064 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1396/2756] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:51 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:52.295617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:52.296226 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:52.302798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:52.303248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:52.303998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:52.304676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:52.439202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:52.447192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7754a5a8-e004-4829-a68b-7dde15337817 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.155469 Jul 29 06:52:52.447745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1361/2757] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:52 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:53.468616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:53.469236 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:53.476055 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:53.477356 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:53.478136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:53.478585 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:53.609124 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:53.617590 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-84421bf4-5756-4906-a028-5ca97cd9291e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152684 Jul 29 06:52:53.618145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1397/2758] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:53 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:54.638899 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:54.639539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:54.645674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:54.646123 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:54.646875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:54.647309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:54.781276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:54.791678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7d5eeb1b-20a8-43e5-a8e3-6b11be0200d6 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156396 Jul 29 06:52:54.792046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1362/2759] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:54 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:55.812932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:55.813543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:55.820026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:55.820475 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:55.821272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:55.821711 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:55.948233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:55.957449 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f7cebc6b-d571-4e5e-9bc5-bb7a703eebdc tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147798 Jul 29 06:52:55.958028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1398/2760] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:55 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:56.979683 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:56.980299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:56.986990 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:56.987381 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:56.988139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:56.988602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:57.114113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:57.123086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-940919ae-f230-4d6d-b055-7d24df6dc2f7 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148226 Jul 29 06:52:57.123662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1363/2761] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:56 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:58.144334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:58.144895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:58.151960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:58.152410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:58.153185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:58.153618 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:58.283500 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:58.291563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-16a60d5c-4aa4-4c88-bf4b-f7402f197e1e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151139 Jul 29 06:52:58.292119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1399/2762] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:58 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:52:59.311895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:52:59.312505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:52:59.318918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:59.319366 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:59.320361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:52:59.320825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:52:59.446579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:52:59.454451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-46d038be-af5c-4311-8bd5-ed724127fc7c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146435 Jul 29 06:52:59.455002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1364/2763] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:52:59 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:00.475518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:00.476710 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:00.483271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:00.483715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:00.484465 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:00.484921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:00.613678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:00.622552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-94dc362c-3947-4e63-a3dc-0c4a97f3975e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150897 Jul 29 06:53:00.623113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1400/2764] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:00 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:01.644080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:01.644710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:01.651930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:01.652371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:01.653147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:01.653579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:01.783651 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:01.791724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1274e410-85c3-4d9a-a384-a8cfdf6e63f0 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.151534 Jul 29 06:53:01.792286 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1365/2765] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:01 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:02.813094 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:02.813708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:02.821135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:02.821592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:02.822390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:02.822828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:02.952958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:02.961466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a7cf39ac-b690-44dc-a30a-0a6d80c264e1 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152166 Jul 29 06:53:02.962063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1401/2766] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:02 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:03.983482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:03.984024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:03.991173 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:03.992188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:03.993100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:03.993542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:04.118849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:04.126741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-58b871c6-fb53-443f-b8c1-220f3d50c77b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147864 Jul 29 06:53:04.127304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1366/2767] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:03 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:05.149174 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:05.149802 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:05.156272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:05.156770 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:05.157535 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:05.157979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:05.286897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:05.295240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1fd9a5e0-8559-414d-a299-944fc1b3133e tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150808 Jul 29 06:53:05.295801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1402/2768] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:05 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:06.316470 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:06.317107 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:06.323691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:06.324146 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:06.324923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:06.325354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:06.453444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:06.462061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-92dfb3dc-ca13-44cd-9374-7861bdb3a53c tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149447 Jul 29 06:53:06.462620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1367/2769] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:06 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:07.483365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:07.483973 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:07.490488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:07.490935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:07.492386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:07.492874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:07.621300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:07.629132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a2b1d410-2ced-4354-a68b-1a15d74ff83d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.149597 Jul 29 06:53:07.629619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1403/2770] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:07 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:08.651000 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:08.651615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:08.654019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=26 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:08.659492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:08.659939 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:08.660724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:08.661162 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:08.791027 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:08.798904 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a11cca14-11c8-46fd-92d2-c740f026e416 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.152540 Jul 29 06:53:08.799464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1368/2771] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:08 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:09.819099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:09.820232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:09.822669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=26 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:09.828189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:09.828667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:09.829416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:09.829848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:09.961783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:09.970042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9d88654d-e980-4edd-8438-a91f65182cad tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.154774 Jul 29 06:53:09.970597 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1404/2772] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:09 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:10.991354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:10.992485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:10.998949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:10.999403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:11.000163 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:11.000626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:11.126194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:11.134577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9c913da5-c22c-42f5-9d9a-7c87c92baf68 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.147233 Jul 29 06:53:11.135138 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1369/2773] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:10 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:12.156043 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:12.156675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:12.163718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:12.164272 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:12.165059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:12.165491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:12.294734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:12.302682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4d10f7d1-8907-4d5e-8311-7647dbbe9794 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150415 Jul 29 06:53:12.303397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1405/2774] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:12 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:13.324225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:13.324882 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:13.331334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:13.331784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:13.332527 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:13.332985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:13.462905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:13.471050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aea7ace9-467e-4464-af28-fb684915ae1b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.150772 Jul 29 06:53:13.471606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1370/2775] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:13 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:14.463921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:53:14.464433 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:53:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:53:14.492134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:14.492792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:14.499275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:14.499719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:14.500478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:14.500937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:14.625358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:14.634072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-76a63a4c-f11f-4c12-9873-37291dbed552 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146204 Jul 29 06:53:14.634621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1406/2776] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:14 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:15.655501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:15.656142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:15.662656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:15.663144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:15.663895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:15.664328 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:15.668147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=78 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:15.790207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:15.798073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-21ea41ef-ac13-46aa-8a57-6efce12a04ef tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146676 Jul 29 06:53:15.798641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1371/2777] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:15 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:16.819158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:16.819921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:16.826483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:16.826938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:16.827705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:16.828149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:16.833292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=78 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:16.963679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:16.971657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dcc44b31-8ed8-4285-a8fd-ddf76ded0e03 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156343 Jul 29 06:53:16.972216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1407/2778] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:16 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:17.994151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:17.994706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:18.001142 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:18.001588 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:18.002360 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:18.002790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:18.140165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:18.149064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-be3488a3-1367-41d7-8ea8-22acd36a0f0d tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.159538 Jul 29 06:53:18.150349 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1372/2779] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:17 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:19.170228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:19.170857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:19.177252 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:19.177699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:19.178649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:19.179099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:19.302983 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:19.311708 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-cdcd25c1-5d87-489f-bb69-61b7580448ec tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.145369 Jul 29 06:53:19.312293 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1408/2780] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:19 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:20.331747 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:20.332355 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:20.339497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:20.339948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:20.340719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:20.341150 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:20.466423 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:20.474213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-302fc584-5556-47a0-9b5a-e62704006537 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.146316 Jul 29 06:53:20.474775 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1373/2781] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:20 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:20.664130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:53:20.664338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:53:21.496200 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:21.496828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:21.502985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:21.503437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:21.504199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:21.504673 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:21.639587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:21.648190 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-11b9a1be-48b7-40cb-81ef-49f1888d2b3b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156257 Jul 29 06:53:21.648791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1409/2782] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:21 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:22.668948 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:22.669560 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:22.676065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:22.676522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:22.677300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:22.677748 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:22.811571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:22.821447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-47063491-f5e1-43c0-bc4a-b2c50a53abaa tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.156480 Jul 29 06:53:22.822019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1374/2783] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:22 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:23.843346 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:23.843961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:23.851068 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:23.851523 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:23.852287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:23.852754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:23.979968 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:23.987837 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0899bf6b-b5b9-4d24-aed7-11227163b654 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.148295 Jul 29 06:53:23.988337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1410/2784] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:23 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:25.059203 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:25.059814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:25.065853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:25.066325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:25.067072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:25.067505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:25.192217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:25.200363 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3141c7b8-5faf-4d4d-806e-7ff3f32e717b tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.190799 Jul 29 06:53:25.200956 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1375/2785] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:25 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 06:53:26.222513 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:26.223377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] [instance: 862582d7-9f21-4209-b495-59dfe7509df0] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:26.230547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:26.231036 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:26.231815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:26.232263 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:26.385543 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e05c9bdfc114478b5d80f077b970d17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '002000e5606c46c29c87b0fa2fe68b3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:26.393813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e8b6da6d-cc7e-48df-8141-bfe7bac6e170 tempest-VolumesSnapshotTestJSON-307604271 tempest-VolumesSnapshotTestJSON-307604271-project] 10.222.0.33 "GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0" status: 200 len: 1560 microversion: 2.1 time: 0.175251 Jul 29 06:53:26.394366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1411/2786] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:26 2022] GET /compute/v2.1/servers/862582d7-9f21-4209-b495-59dfe7509df0 => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:27.144372 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:27.144947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:27.151502 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:27.151986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:27.152789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:27.153233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:27.167477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] HTTP exception thrown: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Request method failure captured: Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e HTTP/1.1 Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432fxti8pbSYNfIk9o3lK909ucRXvyHrKqmpzH9oVvs2UiIFjuM9RqA0LRKHJmDJki-jYaMr1eW0A7kaPPUOrHe5w0hKPz02vAQrlHG--dcHNwUWwC56fAw_IhnWIDsRH69WhGM9qDTfRMslQNBnMWUE6fnuZ8CgyqP4ABLUZUUeC2c Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:53:27.169267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3b773b1bba540f79c21b042d5cf91de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: e1b9767f26254a6cba945f4cae562b70 Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.170824 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'c0f47fa5-72de-4c83-a201-89fb8435978e'} Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:53:27.171706 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.173032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.174804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Returning 404 to user: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:53:27.174804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c641e4d9-7f9c-4d17-b121-395bcd8b51a6 tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 404 len: 111 microversion: 2.1 time: 0.030226 Jul 29 06:53:27.174804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1376/2787] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:53:27 2022] DELETE /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:53:27.180196 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:27.180948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] [instance: c0f47fa5-72de-4c83-a201-89fb8435978e] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:27.187135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:27.187591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:27.188410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:27.188942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:27.203510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] HTTP exception thrown: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Request method failure captured: Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e HTTP/1.1 Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432fxti8pbSYNfIk9o3lK909ucRXvyHrKqmpzH9oVvs2UiIFjuM9RqA0LRKHJmDJki-jYaMr1eW0A7kaPPUOrHe5w0hKPz02vAQrlHG--dcHNwUWwC56fAw_IhnWIDsRH69WhGM9qDTfRMslQNBnMWUE6fnuZ8CgyqP4ABLUZUUeC2c Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 06:53:27.205337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a3b773b1bba540f79c21b042d5cf91de", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a3b773b1bba540f79c21b042d5cf91de"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: a3b773b1bba540f79c21b042d5cf91de Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeTestJSON-604791230 Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: e1b9767f26254a6cba945f4cae562b70 Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeTestJSON-604791230-project Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.206919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'c0f47fa5-72de-4c83-a201-89fb8435978e'} Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:53:27.207855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. Jul 29 06:53:27.209466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 06:53:27.211060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] Returning 404 to user: Instance c0f47fa5-72de-4c83-a201-89fb8435978e could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:53:27.211060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dd3a09ae-77ef-4094-ba50-ca1d411b910c tempest-AttachVolumeTestJSON-604791230 tempest-AttachVolumeTestJSON-604791230-project] 10.222.0.33 "GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e" status: 404 len: 111 microversion: 2.1 time: 0.030972 Jul 29 06:53:27.211060 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1412/2788] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:27 2022] GET /compute/v2.1/servers/c0f47fa5-72de-4c83-a201-89fb8435978e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:53:35.873599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-02970aa4-cf9b-462e-83c8-ae4753087f59 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: .version_select at 0x7f1459502160>, body: {"keypair": {"name": "tempest-keypair-1498956444", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVEU2hIhMVglkDwcSPRKziyrmxA8Hd2TYa64XN51F8bn5sy9hlWzkYsZ1Y1AVfMMZtmD4trP7Hmwx5wx8M9K3+xwDOa67E6xTGKe6m+AF6xXQSh7t7R1bgwuzd2r2Y3JA=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:53:35.894014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-02970aa4-cf9b-462e-83c8-ae4753087f59 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for project 10b54d7ff9644981893f886e59f22021. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:53:35.898539 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-02970aa4-cf9b-462e-83c8-ae4753087f59 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for user 12a751b41fd546ac9017c67d6de4ebdd and project 10b54d7ff9644981893f886e59f22021. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:53:35.927303 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-02970aa4-cf9b-462e-83c8-ae4753087f59 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.184156 Jul 29 06:53:35.927888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1377/2789] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 06:53:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:53:37.299684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1643754387", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cd08a0b-93ef-4069-b2d4-e925e8f17ba9"}], "security_groups": [{"name": "tempest-securitygroup--348565504"}], "key_name": "tempest-keypair-1498956444", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:53:37.309023 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=17 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:37.309692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=31 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:37.409519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] validate_networks() for [('6cd08a0b-93ef-4069-b2d4-e925e8f17ba9', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:53:37.843718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:53:37.844149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:53:37.844670 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:53:37.845145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:53:37.845564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:53:37.855505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:37.855950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:37.856798 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:37.857230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:37.874438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for project 10b54d7ff9644981893f886e59f22021. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:53:37.878334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for user 12a751b41fd546ac9017c67d6de4ebdd and project 10b54d7ff9644981893f886e59f22021. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:53:37.889383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:53:37.891648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:53:37.940108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0356a66a-7305-4e57-bad4-a92293f2c8b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.644452 Jul 29 06:53:37.940855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1413/2790] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:53:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:53:37.949510 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=31 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:37.953682 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-66e18673-2830-49b6-b578-d43dd0f84b2d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:37.954141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-66e18673-2830-49b6-b578-d43dd0f84b2d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:38.013046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-66e18673-2830-49b6-b578-d43dd0f84b2d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:38.019962 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-66e18673-2830-49b6-b578-d43dd0f84b2d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1242 microversion: 2.1 time: 0.071629 Jul 29 06:53:38.020516 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1378/2791] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:37 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:39.043839 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:39.044606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:39.053466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:39.054842 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:39.056569 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:39.057092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:39.149761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:39.159481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-250eba34-0465-49da-aaaa-cb67d5872368 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1312 microversion: 2.1 time: 0.122287 Jul 29 06:53:39.165127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1414/2792] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:39 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1312 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:40.182439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:40.183373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:40.186267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:40.200789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:40.201362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:40.202548 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:40.205001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:40.362994 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:40.371471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6be2aaa6-e46d-4cc2-ab52-9d25587b46f7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.194137 Jul 29 06:53:40.372419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1379/2793] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:40 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:40.451591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-d6bd9be2-2844-4710-8e2f-d38d459713b1 req-ecbe6ca9-3c1b-454c-99ac-9bd17a93c854 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e0f8d-3a0a-43db-88ba-36ac438e5660", "tag": "1f30dba3-61ac-447a-8d6c-4de64de6819b"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:53:40.471534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d6bd9be2-2844-4710-8e2f-d38d459713b1 req-ecbe6ca9-3c1b-454c-99ac-9bd17a93c854 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:40.472088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-d6bd9be2-2844-4710-8e2f-d38d459713b1 req-ecbe6ca9-3c1b-454c-99ac-9bd17a93c854 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:40.490778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-d6bd9be2-2844-4710-8e2f-d38d459713b1 req-ecbe6ca9-3c1b-454c-99ac-9bd17a93c854 service nova] Creating event network-changed:1f30dba3-61ac-447a-8d6c-4de64de6819b for instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 on hv-cinder-83482 Jul 29 06:53:40.500453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-d6bd9be2-2844-4710-8e2f-d38d459713b1 req-ecbe6ca9-3c1b-454c-99ac-9bd17a93c854 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061623 Jul 29 06:53:40.501687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1415/2794] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:53:41.392837 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:41.393464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:41.400734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:41.401197 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:41.401992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:41.402437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:41.531764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:41.539460 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6e54f85b-88db-43b8-9122-95e11209ba85 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.150529 Jul 29 06:53:41.540025 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1380/2795] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:41 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:42.561314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:42.562021 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:42.568352 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:42.568840 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:42.569633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:42.570073 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:42.700903 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:42.708366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-65bbdeab-6e39-40ca-8112-c287f98e09fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.151786 Jul 29 06:53:42.708972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1416/2796] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:42 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:43.730042 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:43.730653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:43.737472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:43.737923 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:43.738678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:43.739119 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:43.865952 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:43.873392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-fe9d5e29-67d1-430f-921e-891629e89b79 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.147192 Jul 29 06:53:43.873940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1381/2797] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:43 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:44.893805 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:44.894414 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:44.901480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:44.901923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:44.902672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:44.903100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:45.028357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:45.035966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c2fbb3d5-a3e5-4a1c-ba2a-0e153d974583 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.146023 Jul 29 06:53:45.036519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1417/2798] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:44 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:46.058007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:46.058621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:46.065098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:46.065543 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:46.066291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:46.066724 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:46.200116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:46.207544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-46ddde67-4847-4f4a-894a-dddacf2714f4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.154087 Jul 29 06:53:46.208101 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1382/2799] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:46 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:46.402792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-594b937a-0be6-4b43-9d50-e2f38d4f0e4f req-1a6b3290-e647-495a-bf46-0ce0de98294a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e0f8d-3a0a-43db-88ba-36ac438e5660", "name": "network-vif-plugged", "status": "completed", "tag": "1f30dba3-61ac-447a-8d6c-4de64de6819b"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:53:46.413745 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-594b937a-0be6-4b43-9d50-e2f38d4f0e4f req-1a6b3290-e647-495a-bf46-0ce0de98294a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:46.414583 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-594b937a-0be6-4b43-9d50-e2f38d4f0e4f req-1a6b3290-e647-495a-bf46-0ce0de98294a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:46.426022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-594b937a-0be6-4b43-9d50-e2f38d4f0e4f req-1a6b3290-e647-495a-bf46-0ce0de98294a service nova] Creating event network-vif-plugged:1f30dba3-61ac-447a-8d6c-4de64de6819b for instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 on hv-cinder-83482 Jul 29 06:53:46.431268 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-594b937a-0be6-4b43-9d50-e2f38d4f0e4f req-1a6b3290-e647-495a-bf46-0ce0de98294a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032208 Jul 29 06:53:46.431854 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1418/2800] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:53:47.230044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:47.230668 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:47.237165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:47.237623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:47.238382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:47.238826 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:47.367813 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:47.375167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-decbf75a-e4f2-4553-ac64-8ec77596acfc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1367 microversion: 2.1 time: 0.149602 Jul 29 06:53:47.375732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1383/2801] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:47 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:48.392915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:48.393684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:48.398103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:48.398800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:48.405821 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:48.406275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:48.407033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:48.407502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:48.537037 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:53:48.545408 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c50e378a-0e42-46fd-a0f3-144f4cb4ebdc tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1557 microversion: 2.1 time: 0.153896 Jul 29 06:53:48.546002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1419/2802] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:53:48 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:53:48.565802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:53:48.566302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:53:48.568128 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:53:48.574185 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:48.574637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:48.575396 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:48.575836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:48.653196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2813621e-05b1-432f-b348-b3606cb63a07 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091111 Jul 29 06:53:48.653788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1384/2803] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 06:53:48 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 06:53:49.629599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-9f95364e-0679-4e33-9c1b-0c6d37fc02c5 req-779299b5-416e-4b43-8a77-04e332f075f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c87e0f8d-3a0a-43db-88ba-36ac438e5660", "tag": "1f30dba3-61ac-447a-8d6c-4de64de6819b"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:53:49.639616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-9f95364e-0679-4e33-9c1b-0c6d37fc02c5 req-779299b5-416e-4b43-8a77-04e332f075f4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:53:49.640066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-9f95364e-0679-4e33-9c1b-0c6d37fc02c5 req-779299b5-416e-4b43-8a77-04e332f075f4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:53:49.651587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-9f95364e-0679-4e33-9c1b-0c6d37fc02c5 req-779299b5-416e-4b43-8a77-04e332f075f4 service nova] Creating event network-changed:1f30dba3-61ac-447a-8d6c-4de64de6819b for instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 on hv-cinder-83482 Jul 29 06:53:49.656642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-9f95364e-0679-4e33-9c1b-0c6d37fc02c5 req-779299b5-416e-4b43-8a77-04e332f075f4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093282 Jul 29 06:53:49.657227 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1420/2804] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:54:19.209099 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=11 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:54:19.209928 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=34 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:54:19.214293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:54:19.214790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:54:19.221586 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:54:19.222045 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:54:19.222806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:54:19.223253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:54:19.246664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6110e731-cfbe-4ad1-a780-d5c6c2f07861 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660/ips" status: 200 len: 150 microversion: 2.1 time: 0.038978 Jul 29 06:54:19.247233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1385/2805] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:54:19 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:55:19.326040 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:55:19.326784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=32 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:55:19.331909 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:19.332487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:19.340976 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:19.341426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:19.342212 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:19.342649 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:19.367431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:55:19.444887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a56b4808-bd56-4403-8819-dbb5868b700b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 204 len: 0 microversion: 2.1 time: 0.120349 Jul 29 06:55:19.449514 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1421/2806] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 06:55:19 2022] DELETE /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 06:55:19.452170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:55:19.452984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=4 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:55:19.457277 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:19.457984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:19.465526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:19.466059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:19.466846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:19.467294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:19.600297 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:19.608452 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e6871b8c-3dbf-468a-92fc-b0975f392bd1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1682 microversion: 2.1 time: 0.158179 Jul 29 06:55:19.609050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1386/2807] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:19 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:19.621713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:55:19.622034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:55:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:55:20.630528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:20.631265 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:20.638301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:20.638756 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:20.639516 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:20.639956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:20.809193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:20.817044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-dc70caf9-33ea-4bd1-b12c-968fb9632fab tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1682 microversion: 2.1 time: 0.190715 Jul 29 06:55:20.817786 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1422/2808] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:20 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:21.645525 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-81b722d6-522f-4ab5-b6e4-cc9deecdd446 req-9bc57831-976e-4483-93c7-eaaa9d3f9f11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c87e0f8d-3a0a-43db-88ba-36ac438e5660", "name": "network-vif-deleted", "tag": "1f30dba3-61ac-447a-8d6c-4de64de6819b"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:55:21.663180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-81b722d6-522f-4ab5-b6e4-cc9deecdd446 req-9bc57831-976e-4483-93c7-eaaa9d3f9f11 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:21.663646 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-81b722d6-522f-4ab5-b6e4-cc9deecdd446 req-9bc57831-976e-4483-93c7-eaaa9d3f9f11 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:21.686626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-81b722d6-522f-4ab5-b6e4-cc9deecdd446 req-9bc57831-976e-4483-93c7-eaaa9d3f9f11 service nova] Creating event network-vif-deleted:1f30dba3-61ac-447a-8d6c-4de64de6819b for instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 on hv-cinder-83482 Jul 29 06:55:21.698967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-81b722d6-522f-4ab5-b6e4-cc9deecdd446 req-9bc57831-976e-4483-93c7-eaaa9d3f9f11 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120236 Jul 29 06:55:21.699571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1387/2809] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:55:21.840464 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:21.841138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:21.847165 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:21.847616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:21.848371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:21.848830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:21.879867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:21.880314 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:21.880782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lazy-loading 'fault' on Instance uuid c87e0f8d-3a0a-43db-88ba-36ac438e5660 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 06:55:21.924194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:21.932371 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6b3410d7-ea0f-402c-a73a-77dcc8b14a6a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 200 len: 1332 microversion: 2.1 time: 0.096142 Jul 29 06:55:21.934038 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1423/2810] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:21 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:22.955239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:22.955941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:22.962120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:22.962571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:22.964288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:22.964762 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:22.977909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 HTTP/1.1 Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:55:22.979713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 06:55:22.981446 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'c87e0f8d-3a0a-43db-88ba-36ac438e5660'} Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:55:22.982438 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 06:55:22.984030 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:55:22.985637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:55:22.985637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0ea43b82-8886-464a-96d8-fe190dc1047a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 404 len: 111 microversion: 2.1 time: 0.030596 Jul 29 06:55:22.985637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1388/2811] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:22 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 06:55:22.990128 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5f82b708-3fb8-41e3-84fa-3b0817d636a4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '.version_select at 0x7f145e36e940>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:23.014511 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5f82b708-3fb8-41e3-84fa-3b0817d636a4 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498956444" status: 202 len: 0 microversion: 2.1 time: 0.028108 Jul 29 06:55:23.015278 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1424/2812] 10.222.0.33 () {58 vars in 1221 bytes} [Fri Jul 29 06:55:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1498956444 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 06:55:23.626802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f22d89cd-cde7-43f4-8a38-278e6cf1e2d7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: .version_select at 0x7f145e358790>, body: {"keypair": {"name": "tempest-keypair-53809451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCr3TXLiteEiHIsaVD8lOu+BcJxPKm+meuddcFuG4ZaHPFsTrqEi3fdM8hoGD2omFzDS2NggRK8oHWIaToVpW9UH2JKxJ6TirhcebQzydXS+voUgZ0ZZ/M+ztI1iMd9KHQ=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:55:23.642415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-f22d89cd-cde7-43f4-8a38-278e6cf1e2d7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for project 10b54d7ff9644981893f886e59f22021. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:55:23.646147 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-f22d89cd-cde7-43f4-8a38-278e6cf1e2d7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for user 12a751b41fd546ac9017c67d6de4ebdd and project 10b54d7ff9644981893f886e59f22021. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:55:23.669034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f22d89cd-cde7-43f4-8a38-278e6cf1e2d7 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046031 Jul 29 06:55:23.669621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1389/2813] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 06:55:23 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:55:24.867496 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-422917594", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cd08a0b-93ef-4069-b2d4-e925e8f17ba9"}], "security_groups": [{"name": "tempest-securitygroup--1839130826"}], "key_name": "tempest-keypair-53809451", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:55:24.970512 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] validate_networks() for [('6cd08a0b-93ef-4069-b2d4-e925e8f17ba9', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 06:55:25.327112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 06:55:25.327534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 06:55:25.328004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 06:55:25.328442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 06:55:25.328875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 06:55:25.337572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:25.338682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:25.339467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:25.339899 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:25.356785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for project 10b54d7ff9644981893f886e59f22021. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 06:55:25.360657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for user 12a751b41fd546ac9017c67d6de4ebdd and project 10b54d7ff9644981893f886e59f22021. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 06:55:25.371386 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 06:55:25.373600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 06:55:25.420481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7de5a115-4a81-4968-873f-ea645a391607 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.557669 Jul 29 06:55:25.421119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1425/2814] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 06:55:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 06:55:25.432759 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ee4b13d7-8f5d-4cc5-81fa-98576f16daea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:25.433385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ee4b13d7-8f5d-4cc5-81fa-98576f16daea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:25.491391 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ee4b13d7-8f5d-4cc5-81fa-98576f16daea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:25.499113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ee4b13d7-8f5d-4cc5-81fa-98576f16daea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1239 microversion: 2.1 time: 0.070882 Jul 29 06:55:25.499670 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1390/2815] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:25 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:26.521442 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:26.522059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:26.528932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:26.529385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:26.530253 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:26.530689 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:26.594089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:26.601448 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-6d0a5b5f-232b-468d-a83a-8e97a4fa63dd tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1297 microversion: 2.1 time: 0.084744 Jul 29 06:55:26.602014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1426/2816] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:26 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:27.624369 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:27.625093 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:27.633014 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:27.640307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:27.642034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:27.642545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:27.839626 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:27.848050 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-85ea3b63-2c4f-4461-92c5-07ac062a52e1 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1365 microversion: 2.1 time: 0.227863 Jul 29 06:55:27.848644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1391/2817] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:27 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:28.015935 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-a10888cf-bf89-427c-972f-116beb3993bc req-9a315b42-00f2-4cb0-9862-701353b0e98a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e3e04c-6b78-4435-bdd9-23e80b507cd5", "tag": "28a5ef0b-cd37-4a7a-a8e1-e41016370f99"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:55:28.028411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a10888cf-bf89-427c-972f-116beb3993bc req-9a315b42-00f2-4cb0-9862-701353b0e98a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:28.036287 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-a10888cf-bf89-427c-972f-116beb3993bc req-9a315b42-00f2-4cb0-9862-701353b0e98a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:28.053385 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-a10888cf-bf89-427c-972f-116beb3993bc req-9a315b42-00f2-4cb0-9862-701353b0e98a service nova] Creating event network-changed:28a5ef0b-cd37-4a7a-a8e1-e41016370f99 for instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 on hv-cinder-83482 Jul 29 06:55:28.058966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-a10888cf-bf89-427c-972f-116beb3993bc req-9a315b42-00f2-4cb0-9862-701353b0e98a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050247 Jul 29 06:55:28.061439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1427/2818] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:55:28.872981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:28.873604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:28.880079 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:28.880559 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:28.881333 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:28.881779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:29.009111 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:29.017060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-689350b8-1ec0-43a0-8822-14cc4a9e908a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1365 microversion: 2.1 time: 0.148489 Jul 29 06:55:29.017621 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1392/2819] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:28 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:30.038897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:30.039603 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:30.046029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:30.046486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:30.047254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:30.047707 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:30.179612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:30.187838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5ca502e7-d4d9-4bf5-a40e-40f3e5af6815 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1365 microversion: 2.1 time: 0.153686 Jul 29 06:55:30.188468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1428/2820] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:30 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:31.209384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:31.210188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:31.217821 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:31.218279 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:31.219046 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:31.219491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:31.351537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:31.358973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e23cdd06-88be-4120-8773-329cdc02925d tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1365 microversion: 2.1 time: 0.153489 Jul 29 06:55:31.359531 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1393/2821] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:31 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:32.379566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:32.380183 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:32.387502 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:32.387953 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:32.388755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:32.389195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:32.519907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:32.527759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3bea417e-80e8-4633-8d12-5b158e0e3320 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1365 microversion: 2.1 time: 0.152082 Jul 29 06:55:32.528318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1429/2822] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:32 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:32.841606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-55ca6f80-c371-42ad-b9aa-4b96b4079266 req-16c0b93f-d48d-4be7-9cf5-46e09d018e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e3e04c-6b78-4435-bdd9-23e80b507cd5", "name": "network-vif-plugged", "status": "completed", "tag": "28a5ef0b-cd37-4a7a-a8e1-e41016370f99"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:55:32.855916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-55ca6f80-c371-42ad-b9aa-4b96b4079266 req-16c0b93f-d48d-4be7-9cf5-46e09d018e44 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:32.856399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-55ca6f80-c371-42ad-b9aa-4b96b4079266 req-16c0b93f-d48d-4be7-9cf5-46e09d018e44 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:32.868004 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-55ca6f80-c371-42ad-b9aa-4b96b4079266 req-16c0b93f-d48d-4be7-9cf5-46e09d018e44 service nova] Creating event network-vif-plugged:28a5ef0b-cd37-4a7a-a8e1-e41016370f99 for instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 on hv-cinder-83482 Jul 29 06:55:32.873368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-55ca6f80-c371-42ad-b9aa-4b96b4079266 req-16c0b93f-d48d-4be7-9cf5-46e09d018e44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093734 Jul 29 06:55:32.873908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1394/2823] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:55:33.548781 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:33.549401 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:33.555895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:33.556426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:33.557443 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:33.557883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:33.688306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:33.695682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a7602293-c179-41ae-bf38-45c80eb0f185 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1365 microversion: 2.1 time: 0.150766 Jul 29 06:55:33.696237 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1430/2824] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:33 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:34.718151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:34.718859 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:34.725602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:34.726051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:34.726803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:34.727240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:34.858597 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:55:34.866129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-49662ba4-4421-4f13-b3c5-69f6dcd155be tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1554 microversion: 2.1 time: 0.152132 Jul 29 06:55:34.866693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1395/2825] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 06:55:34 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 06:55:34.887430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:55:34.887956 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:55:34.894365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:34.894819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:34.895576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:34.896017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:34.972915 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-514b04b3-7e64-471e-a849-b8a61efd53fa tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090010 Jul 29 06:55:34.973507 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1431/2826] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 06:55:34 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:55:35.890422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-cbaf6814-ae79-4ad5-95f0-0649e1ff154a req-02188e3f-af10-49a2-9692-b7700489bdba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e3e04c-6b78-4435-bdd9-23e80b507cd5", "tag": "28a5ef0b-cd37-4a7a-a8e1-e41016370f99"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:55:35.895220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:55:35.902485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-cbaf6814-ae79-4ad5-95f0-0649e1ff154a req-02188e3f-af10-49a2-9692-b7700489bdba service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:55:35.902936 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-cbaf6814-ae79-4ad5-95f0-0649e1ff154a req-02188e3f-af10-49a2-9692-b7700489bdba service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:55:35.914442 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-cbaf6814-ae79-4ad5-95f0-0649e1ff154a req-02188e3f-af10-49a2-9692-b7700489bdba service nova] Creating event network-changed:28a5ef0b-cd37-4a7a-a8e1-e41016370f99 for instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 on hv-cinder-83482 Jul 29 06:55:35.920231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-cbaf6814-ae79-4ad5-95f0-0649e1ff154a req-02188e3f-af10-49a2-9692-b7700489bdba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033393 Jul 29 06:55:35.921234 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1396/2827] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:56:05.426555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:56:05.427358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:56:05.428730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:56:05.429403 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:56:05.434477 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:56:05.434979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:56:05.443049 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:56:05.443466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:56:05.444281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:56:05.444762 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:56:05.472717 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-85ea9761-7bd9-4a54-abb3-892a1fa0c187 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/ips" status: 200 len: 148 microversion: 2.1 time: 0.046917 Jul 29 06:56:05.473281 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1432/2828] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 06:56:05 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/ips => generated 148 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:57:28.160213 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa12e9ad-6246-4235-a005-6f1fb6bfbdd1] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 06:57:28.160804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:57:28.161688 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=38 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:57:28.167905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:57:28.168493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:57:28.177351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:28.177807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:28.178609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:28.179039 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:28.204280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 06:57:28.279479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-37224b2b-be01-46fc-816e-b58ee1f4f6e0 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 204 len: 0 microversion: 2.20 time: 0.121032 Jul 29 06:57:28.280056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1397/2829] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Jul 29 06:57:28 2022] DELETE /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 06:57:28.291841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:57:28.292453 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:57:28.294891 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c5be021-ab08-4863-960d-150f96f9760b] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 06:57:28.295338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=4 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:57:28.295963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 06:57:28.302993 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:28.303441 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:28.304203 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:28.304676 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:28.490888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:57:28.498992 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:57:28.500528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:57:28.501727 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2f7e5593-9078-4f7a-8e67-c4ec26e4a055 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1724 microversion: 2.20 time: 0.216151 Jul 29 06:57:28.502271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1433/2830] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:57:28 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:57:29.525648 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:57:29.526317 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:57:29.536599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:29.537059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:29.537835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:29.538377 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:29.546013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa12e9ad-6246-4235-a005-6f1fb6bfbdd1] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42894. Jul 29 06:57:29.680641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:57:29.690159 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:57:29.692325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '217b321936224e2ba928b983c4e40017', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8d1f62a52884ebb91749ef49de11bec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 06:57:29.693900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ca1d5a85-ee09-4fa8-af53-7c2d4ecf7428 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 200 len: 1656 microversion: 2.20 time: 0.172621 Jul 29 06:57:29.710089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1398/2831] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:57:29 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 1656 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 06:57:29.728529 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-cea7991c-7f73-4d0a-801e-56d641114131 req-3390ac75-6706-4e45-9696-7520a19c2192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbb95b1b-f883-46e7-90c8-a740a4a27ca9", "name": "network-vif-deleted", "tag": "f8e6adff-418f-4832-8f59-ec5ea31168b9"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 06:57:29.746158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-cea7991c-7f73-4d0a-801e-56d641114131 req-3390ac75-6706-4e45-9696-7520a19c2192 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:29.747549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-cea7991c-7f73-4d0a-801e-56d641114131 req-3390ac75-6706-4e45-9696-7520a19c2192 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:29.762804 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-cea7991c-7f73-4d0a-801e-56d641114131 req-3390ac75-6706-4e45-9696-7520a19c2192 service nova] Creating event network-vif-deleted:f8e6adff-418f-4832-8f59-ec5ea31168b9 for instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 on hv-cinder-83482 Jul 29 06:57:29.768767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-cea7991c-7f73-4d0a-801e-56d641114131 req-3390ac75-6706-4e45-9696-7520a19c2192 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044044 Jul 29 06:57:29.769749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1434/2832] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 06:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 06:57:30.718245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:57:30.718861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 06:57:30.725914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:30.726380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:30.727167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 06:57:30.727613 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 06:57:30.742231 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] HTTP exception thrown: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Request method failure captured: Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 HTTP/1.1 Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432oDi6z5fuummetSbw-wZbFhgBv8wEWwGuJuzXRzY0jA6pgZXN0TKSu3ICt0iw7ciiVXX3rk8sOK-axNlCsKIAy6TI3LBXs7fM-Y-j7FzrZ3q6CbsmDV9dnresuljr5MRLmbecJ1JjCwJ9rZ49IxEcjFlVgF6PRzdFme3K6JB-Thok Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 06:57:30.744392 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8d1f62a52884ebb91749ef49de11bec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 217b321936224e2ba928b983c4e40017 Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 06:57:30.746343 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'fbb95b1b-f883-46e7-90c8-a740a4a27ca9'} Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 06:57:30.747760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 06:57:30.749361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 06:57:30.752365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Returning 404 to user: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 06:57:30.752365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6bf74cd4-275c-46d2-8817-f9d2d36940bd tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 404 len: 111 microversion: 2.20 time: 0.031598 Jul 29 06:57:30.752365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1399/2833] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 06:57:30 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 06:57:30.752849 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c5be021-ab08-4863-960d-150f96f9760b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 42902. Jul 29 06:57:30.756681 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4a551787-1358-4323-8396-733caf921a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '.version_select at 0x7f1459af6670>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 06:57:30.775576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4a551787-1358-4323-8396-733caf921a34 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844759825" status: 204 len: 0 microversion: 2.20 time: 0.024292 Jul 29 06:57:30.776359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1435/2834] 10.222.0.33 () {60 vars in 1262 bytes} [Fri Jul 29 06:57:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1844759825 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 06:58:14.474148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:58:14.474881 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 06:58:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:58:20.673371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:58:20.674496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 06:58:39.629579 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 06:58:39.630339 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 06:58:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:00:18.598890 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:00:18.599489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:00:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:00:31.438482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:00:31.439734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:00:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:01:22.965861 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR oslo.messaging._drivers.impl_rabbit [-] [aa12e9ad-6246-4235-a005-6f1fb6bfbdd1] AMQP server on 10.222.0.33:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 07:01:22.967710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:22.969536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:22.975664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e4d8468-83b3-4a82-b26a-2ead098bac0f"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:22.979431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:22.994946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:22.994946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:22.996037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:22.997846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:23.902878 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6c5be021-ab08-4863-960d-150f96f9760b] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 07:01:23.903521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=8 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:23.904348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:23.909510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:23.910410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:23.920426 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:23.921004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:23.922106 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:23.922635 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:23.949412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:01:23.979451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] [aa12e9ad-6246-4235-a005-6f1fb6bfbdd1] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43036. Jul 29 07:01:24.059875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f649afc9-e223-43b7-b3cd-16c901cfd0ce tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "DELETE /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 204 len: 0 microversion: 2.1 time: 0.158960 Jul 29 07:01:24.062009 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1436/2835] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:01:23 2022] DELETE /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 07:01:24.073336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:24.074310 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:24.081455 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:24.082659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:24.083967 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:24.084625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:24.163877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3b6c9a28-7aab-4f80-8f84-c465a7c2a8a9 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.201072 Jul 29 07:01:24.167246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1400/2836] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 07:01:22 2022] POST /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments => generated 194 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:24.293297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:24.302999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bdab4f96-47fe-46de-9151-ec096ca96b92 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1508 microversion: 2.1 time: 0.234287 Jul 29 07:01:24.303702 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1437/2837] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:24 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:24.337508 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-6a381f72-8426-43cc-8a1d-f654fe1fb28c req-6046ad6d-1b82-4d8c-a620-ca4e84abd578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "862582d7-9f21-4209-b495-59dfe7509df0", "name": "network-vif-deleted", "tag": "1d15d9c9-1fdb-4575-820e-c126c0ed046d"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:24.347467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-6a381f72-8426-43cc-8a1d-f654fe1fb28c req-6046ad6d-1b82-4d8c-a620-ca4e84abd578 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:24.348440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-6a381f72-8426-43cc-8a1d-f654fe1fb28c req-6046ad6d-1b82-4d8c-a620-ca4e84abd578 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:24.359489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-6a381f72-8426-43cc-8a1d-f654fe1fb28c req-6046ad6d-1b82-4d8c-a620-ca4e84abd578 service nova] Creating event network-vif-deleted:1d15d9c9-1fdb-4575-820e-c126c0ed046d for instance 862582d7-9f21-4209-b495-59dfe7509df0 on hv-cinder-83482 Jul 29 07:01:24.365920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-6a381f72-8426-43cc-8a1d-f654fe1fb28c req-6046ad6d-1b82-4d8c-a620-ca4e84abd578 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150526 Jul 29 07:01:24.366540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1401/2838] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 07:01:25.324412 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:25.325062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:25.332599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:25.333112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:25.333950 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:25.334394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:25.355056 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] [6c5be021-ab08-4863-960d-150f96f9760b] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43072. Jul 29 07:01:25.368867 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:25.369320 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:25.369777 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lazy-loading 'fault' on Instance uuid 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:01:25.414690 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:25.422290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4026b32f-c182-4e0a-bab3-313a33bb5a0e tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 200 len: 1311 microversion: 2.1 time: 0.101602 Jul 29 07:01:25.423390 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1438/2839] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:25 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:26.381390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-a769ca81-faeb-4612-974e-8d474cf9dbd2 req-df395c79-665d-47b8-b255-c625dd4dcab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65", "name": "network-vif-deleted", "tag": "c4cfd182-fc76-4e2f-8b38-5663e698a6ba"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:26.393013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-a769ca81-faeb-4612-974e-8d474cf9dbd2 req-df395c79-665d-47b8-b255-c625dd4dcab7 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.393556 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-a769ca81-faeb-4612-974e-8d474cf9dbd2 req-df395c79-665d-47b8-b255-c625dd4dcab7 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.405003 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-a769ca81-faeb-4612-974e-8d474cf9dbd2 req-df395c79-665d-47b8-b255-c625dd4dcab7 service nova] Creating event network-vif-deleted:c4cfd182-fc76-4e2f-8b38-5663e698a6ba for instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 on hv-cinder-83482 Jul 29 07:01:26.411090 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-a769ca81-faeb-4612-974e-8d474cf9dbd2 req-df395c79-665d-47b8-b255-c625dd4dcab7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033880 Jul 29 07:01:26.411784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1402/2840] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:26.444470 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:26.445117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:26.451614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.452063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.452883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.453329 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.467126 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] HTTP exception thrown: Instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 could not be found. Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Request method failure captured: Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 HTTP/1.1 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432aLpZNoxOpwzy03jMfkuifWw-eHjv1eAOVtBVJETSXTO1aHbVSf8HiqQOGd9XGEJ5u0X9ktb5_PN9hCinMSg3Jqx7H9cMj0kIca5tJ2GJ_6LXL8gEXuKhto7dIywdjwTBHUhr9qY3uTf3nn8kexXBRMtoTn9tqbT-PCc4Xh098BH4 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:01:26.468841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_872e2c13f9b346598c261de5609fdf89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: b34e3e2e2e6049428295588959ca595c Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 could not be found. Jul 29 07:01:26.470730 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65'} Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 could not be found. Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:01:26.471741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 could not be found. Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 could not be found. Jul 29 07:01:26.473921 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:26.475510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Returning 404 to user: Instance 88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:01:26.475510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9e61361e-1fe7-46fc-87bb-878b5869b0f8 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65" status: 404 len: 111 microversion: 2.1 time: 0.030922 Jul 29 07:01:26.475510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1439/2841] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:26 2022] GET /compute/v2.1/servers/88c6e8a2-cbf5-4bb7-b67c-4c8f2e3c1b65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:01:26.480063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:26.480678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:26.487113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.487593 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.489276 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.489750 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.519348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:01:26.605358 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b9f3f8fb-c2a9-4f01-a20b-58b047ef0ad6 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 204 len: 0 microversion: 2.1 time: 0.128939 Jul 29 07:01:26.606431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1403/2842] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:01:26 2022] DELETE /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 07:01:26.615800 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:26.616424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:26.622546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.623002 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.623773 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:26.624402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:26.765280 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:26.773787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca9ef546-66e9-4ccf-987f-be884d78efad tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1521 microversion: 2.1 time: 0.162774 Jul 29 07:01:26.774427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1440/2843] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:26 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:01:27.795895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:27.796526 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:27.803429 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:27.803886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:27.804692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:27.805135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:27.838728 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:27.838949 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:27.839605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lazy-loading 'fault' on Instance uuid f5dc91c9-6f94-4b19-a397-19669b267c43 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:01:27.887535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b34e3e2e2e6049428295588959ca595c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '872e2c13f9b346598c261de5609fdf89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:27.896280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b6c9c9e6-699a-4337-b923-d9250700fdff tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 200 len: 1311 microversion: 2.1 time: 0.104630 Jul 29 07:01:27.897245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1404/2844] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:27 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:01:28.590140 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-49b07957-4cd7-4f29-bc06-ddfa53eb74f8 req-31e5d2fb-39f3-47db-8746-cd7888f6a3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dc91c9-6f94-4b19-a397-19669b267c43", "name": "network-vif-deleted", "tag": "46170f3e-ab09-4001-b12d-354d2c3ac6c5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:28.601608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-49b07957-4cd7-4f29-bc06-ddfa53eb74f8 req-31e5d2fb-39f3-47db-8746-cd7888f6a3c1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:28.602337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-49b07957-4cd7-4f29-bc06-ddfa53eb74f8 req-31e5d2fb-39f3-47db-8746-cd7888f6a3c1 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:28.615122 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-49b07957-4cd7-4f29-bc06-ddfa53eb74f8 req-31e5d2fb-39f3-47db-8746-cd7888f6a3c1 service nova] Creating event network-vif-deleted:46170f3e-ab09-4001-b12d-354d2c3ac6c5 for instance f5dc91c9-6f94-4b19-a397-19669b267c43 on hv-cinder-83482 Jul 29 07:01:28.620189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-49b07957-4cd7-4f29-bc06-ddfa53eb74f8 req-31e5d2fb-39f3-47db-8746-cd7888f6a3c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Jul 29 07:01:28.620822 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1441/2845] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:28.921752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:28.924133 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] [instance: f5dc91c9-6f94-4b19-a397-19669b267c43] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:28.936927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:28.937703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:28.939863 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:28.940389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:28.954602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] HTTP exception thrown: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 could not be found. Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Request method failure captured: Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 HTTP/1.1 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432aLpZNoxOpwzy03jMfkuifWw-eHjv1eAOVtBVJETSXTO1aHbVSf8HiqQOGd9XGEJ5u0X9ktb5_PN9hCinMSg3Jqx7H9cMj0kIca5tJ2GJ_6LXL8gEXuKhto7dIywdjwTBHUhr9qY3uTf3nn8kexXBRMtoTn9tqbT-PCc4Xh098BH4 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:01:28.956685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_872e2c13f9b346598c261de5609fdf89", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/872e2c13f9b346598c261de5609fdf89"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 872e2c13f9b346598c261de5609fdf89 Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1732090118 Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: b34e3e2e2e6049428295588959ca595c Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1732090118-project Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 could not be found. Jul 29 07:01:28.958345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'f5dc91c9-6f94-4b19-a397-19669b267c43'} Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 could not be found. Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:01:28.959488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 could not be found. Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 could not be found. Jul 29 07:01:28.961118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:28.962535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] Returning 404 to user: Instance f5dc91c9-6f94-4b19-a397-19669b267c43 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:01:28.962535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cf5b8c96-2b1a-4211-834f-f18218a21572 tempest-ServerRescueNegativeTestJSON-1732090118 tempest-ServerRescueNegativeTestJSON-1732090118-project] 10.222.0.33 "GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43" status: 404 len: 111 microversion: 2.1 time: 0.044475 Jul 29 07:01:28.962535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1405/2846] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:28 2022] GET /compute/v2.1/servers/f5dc91c9-6f94-4b19-a397-19669b267c43 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:01:31.899876 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e4d8468-83b3-4a82-b26a-2ead098bac0f"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:31.906870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:31.924444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:31.925378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:31.927657 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:31.928327 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:32.063987 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Invalid volume: volume 5e4d8468-83b3-4a82-b26a-2ead098bac0f is already attached to instances: 03e3e04c-6b78-4435-bdd9-23e80b507cd5 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: POST /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments HTTP/1.1 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 74 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:01:32.067741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {"volumeAttachment": {"volumeId": "5e4d8468-83b3-4a82-b26a-2ead098bac0f"}} Jul 29 07:01:32.070515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Invalid volume: volume 5e4d8468-83b3-4a82-b26a-2ead098bac0f is already attached to instances: 03e3e04c-6b78-4435-bdd9-23e80b507cd5 Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'server_id': '03e3e04c-6b78-4435-bdd9-23e80b507cd5', 'body': {'volumeAttachment': {'volumeId': '5e4d8468-83b3-4a82-b26a-2ead098bac0f'}}} Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5e4d8468-83b3-4a82-b26a-2ead098bac0f is already attached to instances: 03e3e04c-6b78-4435-bdd9-23e80b507cd5 Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:32.072275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5e4d8468-83b3-4a82-b26a-2ead098bac0f is already attached to instances: 03e3e04c-6b78-4435-bdd9-23e80b507cd5 Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:32.074549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:32.076206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:32.076206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:01:32.076206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:01:32.076206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5e4d8468-83b3-4a82-b26a-2ead098bac0f is already attached to instances: 03e3e04c-6b78-4435-bdd9-23e80b507cd5 Jul 29 07:01:32.076206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:01:32.077857 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 400 to user: Invalid volume: volume 5e4d8468-83b3-4a82-b26a-2ead098bac0f is already attached to instances: 03e3e04c-6b78-4435-bdd9-23e80b507cd5 {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:01:32.078918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8bf4044b-2db5-4be0-bc11-08ed47144e17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.185589 Jul 29 07:01:32.085229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1442/2847] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 07:01:31 2022] POST /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 07:01:32.166144 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:32.167298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:32.175151 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:32.176161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:32.177650 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:32.178538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:32.336088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.objects.instance [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lazy-loading 'services' on Instance uuid 03e3e04c-6b78-4435-bdd9-23e80b507cd5 {{(pid=117957) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:01:32.448703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e78a549a-e7d2-44bf-a695-04943ae21629 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments/5e4d8468-83b3-4a82-b26a-2ead098bac0f" status: 202 len: 0 microversion: 2.1 time: 0.289071 Jul 29 07:01:32.452465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1406/2848] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 07:01:32 2022] DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments/5e4d8468-83b3-4a82-b26a-2ead098bac0f => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:01:32.458520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:32.461232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:32.480275 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:32.480738 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:32.481531 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:32.482249 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:32.521652 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-18b637e6-51d8-4914-8aa9-d3887edc8879 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067594 Jul 29 07:01:32.522863 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1443/2849] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 07:01:32 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:33.538403 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:33.545671 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:33.554255 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:33.554711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:33.555672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:33.556592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:33.603217 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c3d05aae-1ce2-4fc9-b830-1817a7686a60 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072606 Jul 29 07:01:33.607757 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1407/2850] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 07:01:33 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 07:01:33.716483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:33.717214 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:33.725646 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:33.726432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:33.727430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:33.728074 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:33.760908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:01:33.965631 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-23239947-f040-4b3e-9c47-38460abecd17 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 204 len: 0 microversion: 2.1 time: 0.252859 Jul 29 07:01:33.969731 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1444/2851] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:01:33 2022] DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 07:01:33.976501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:33.977324 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:33.991927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:33.992383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:33.993179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:33.993617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:34.237624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:34.247664 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-394777bb-2e50-47de-88fd-c66f74217b1a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1678 microversion: 2.1 time: 0.276839 Jul 29 07:01:34.251365 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1408/2852] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:33 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1678 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:01:34.482481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:01:34.482888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:01:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:01:35.277858 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:35.278566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:35.288399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:35.290795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:35.291608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:35.292052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:35.901215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:35.911432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a155161-a0e9-4b5d-9e0a-909f864e3b98 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1678 microversion: 2.1 time: 0.637686 Jul 29 07:01:35.913825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1445/2853] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:35 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1678 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:36.544745 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-33294d5d-bd4a-4aa9-8c8c-f6876f4d55ab req-757b2bcd-45dc-4900-b54c-42ac3eb6fb0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e3e04c-6b78-4435-bdd9-23e80b507cd5", "name": "network-vif-deleted", "tag": "28a5ef0b-cd37-4a7a-a8e1-e41016370f99"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:36.570645 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-33294d5d-bd4a-4aa9-8c8c-f6876f4d55ab req-757b2bcd-45dc-4900-b54c-42ac3eb6fb0d service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:36.571100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-33294d5d-bd4a-4aa9-8c8c-f6876f4d55ab req-757b2bcd-45dc-4900-b54c-42ac3eb6fb0d service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:36.593752 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-33294d5d-bd4a-4aa9-8c8c-f6876f4d55ab req-757b2bcd-45dc-4900-b54c-42ac3eb6fb0d service nova] Creating event network-vif-deleted:28a5ef0b-cd37-4a7a-a8e1-e41016370f99 for instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 on hv-cinder-83482 Jul 29 07:01:36.608371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-33294d5d-bd4a-4aa9-8c8c-f6876f4d55ab req-757b2bcd-45dc-4900-b54c-42ac3eb6fb0d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070830 Jul 29 07:01:36.609653 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1409/2854] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:36.937733 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:36.938355 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:36.948088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:36.952159 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:36.953197 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:36.955383 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:37.059910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:37.061189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:37.062698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lazy-loading 'fault' on Instance uuid 03e3e04c-6b78-4435-bdd9-23e80b507cd5 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:01:37.149490 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:37.165979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5283687e-5956-4f9b-8006-52aa37ac5546 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 200 len: 1329 microversion: 2.1 time: 0.231881 Jul 29 07:01:37.174135 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1446/2855] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:36 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 1329 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:38.197934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:38.199464 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:38.214074 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:38.214740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:38.216100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:38.217022 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:38.252280 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 HTTP/1.1 Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:01:38.263917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:01:38.265603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '03e3e04c-6b78-4435-bdd9-23e80b507cd5'} Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:01:38.266419 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:01:38.267771 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:01:38.283535 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:01:38.285550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-4fd6463c-50af-4bb6-a7ba-ede944acc65a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 404 len: 111 microversion: 2.1 time: 0.097166 Jul 29 07:01:38.286708 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1410/2856] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:38 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:01:38.297260 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-73e732bb-01f6-4b4a-9159-d088eadbcf56 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '.version_select at 0x7f145e35fd30>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:38.340423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-73e732bb-01f6-4b4a-9159-d088eadbcf56 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-53809451" status: 202 len: 0 microversion: 2.1 time: 0.049341 Jul 29 07:01:38.355246 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1447/2857] 10.222.0.33 () {58 vars in 1215 bytes} [Fri Jul 29 07:01:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-53809451 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:01:39.970746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dc1d7987-0bfb-42a3-b1ea-1ad9b2b7de8f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: .version_select at 0x7f145b7be1f0>, body: {"keypair": {"name": "tempest-keypair-445247549", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJCqRIek0l/lvDuCCrcYxwPzruNuLkIG7UAAD8ddDsp/TY0qEBXoUHFEyVgvUlLHXdgvT30nxE0q85EaU2arXbj60B9RaSvJiKYxyBaKCw2M0uiRRt2GRpD3AQvwoKLQww=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:40.016852 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-dc1d7987-0bfb-42a3-b1ea-1ad9b2b7de8f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for project 10b54d7ff9644981893f886e59f22021. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:01:40.032835 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-dc1d7987-0bfb-42a3-b1ea-1ad9b2b7de8f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for user 12a751b41fd546ac9017c67d6de4ebdd and project 10b54d7ff9644981893f886e59f22021. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:01:40.062126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dc1d7987-0bfb-42a3-b1ea-1ad9b2b7de8f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [99ac7d48-d970-4246-895a-07f0a55816b6] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 07:01:41.086437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [None req-dc1d7987-0bfb-42a3-b1ea-1ad9b2b7de8f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [99ac7d48-d970-4246-895a-07f0a55816b6] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43358. Jul 29 07:01:41.108765 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dc1d7987-0bfb-42a3-b1ea-1ad9b2b7de8f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.142303 Jul 29 07:01:41.109361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1411/2858] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 07:01:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:42.895481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1964100764", "imageRef": "093fb191-832c-4baf-8f51-03b14052c42e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cd08a0b-93ef-4069-b2d4-e925e8f17ba9"}], "security_groups": [{"name": "tempest-securitygroup--1424905102"}], "key_name": "tempest-keypair-445247549", "user_data": "}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:43.047334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] validate_networks() for [('6cd08a0b-93ef-4069-b2d4-e925e8f17ba9', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 07:01:43.764284 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 07:01:43.764743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 07:01:43.765452 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 07:01:43.765870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 07:01:43.766290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 07:01:43.785966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:43.790309 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:43.791156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:43.791791 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:43.812623 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for project 10b54d7ff9644981893f886e59f22021. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:01:43.819972 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Getting quotas for user 12a751b41fd546ac9017c67d6de4ebdd and project 10b54d7ff9644981893f886e59f22021. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:01:43.843102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 07:01:43.847004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='093fb191-832c-4baf-8f51-03b14052c42e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 07:01:43.924315 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-605fbdc2-0e89-40b9-a72f-d5204619f355 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.034455 Jul 29 07:01:43.926020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1448/2859] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 07:01:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 07:01:43.937661 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-865bc3db-631a-4610-96f0-0d02a4e6702e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:43.938289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-865bc3db-631a-4610-96f0-0d02a4e6702e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:44.003713 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-865bc3db-631a-4610-96f0-0d02a4e6702e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:44.012456 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-865bc3db-631a-4610-96f0-0d02a4e6702e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1241 microversion: 2.1 time: 0.079442 Jul 29 07:01:44.029356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1412/2860] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:43 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:45.035995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:45.036672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:45.048415 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:45.049906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:45.052593 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:45.053396 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:45.161468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:45.171570 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-baa9e859-980e-4193-81ea-d4d71bf1d923 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1245 microversion: 2.1 time: 0.138063 Jul 29 07:01:45.189039 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1449/2861] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:45 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1245 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:46.197282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:46.197905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:46.205675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:46.206180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:46.207114 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:46.207557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:46.331917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:46.351844 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-580ea23f-0a50-462a-a3a0-4ec5eacca783 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1299 microversion: 2.1 time: 0.158258 Jul 29 07:01:46.358174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1413/2862] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:46 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1299 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:47.393571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:47.406719 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:47.433937 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:47.434931 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:47.435925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:47.436576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:47.742853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:47.754754 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fc2fd61c-6fcd-4af7-b825-d020762f9305 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1367 microversion: 2.1 time: 0.371514 Jul 29 07:01:47.761999 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1450/2863] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:47 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:48.342180 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-82fd0e4e-6108-42d6-87a1-87b10354ca35 req-6732ddac-aeb6-4320-bab6-c8f51f76efc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d", "tag": "d459d409-7ea5-4aea-abd8-293c2ac9f2d0"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:48.360627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-82fd0e4e-6108-42d6-87a1-87b10354ca35 req-6732ddac-aeb6-4320-bab6-c8f51f76efc3 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:48.362032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-82fd0e4e-6108-42d6-87a1-87b10354ca35 req-6732ddac-aeb6-4320-bab6-c8f51f76efc3 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:48.378544 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-82fd0e4e-6108-42d6-87a1-87b10354ca35 req-6732ddac-aeb6-4320-bab6-c8f51f76efc3 service nova] Creating event network-changed:d459d409-7ea5-4aea-abd8-293c2ac9f2d0 for instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d on hv-cinder-83482 Jul 29 07:01:48.398370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-82fd0e4e-6108-42d6-87a1-87b10354ca35 req-6732ddac-aeb6-4320-bab6-c8f51f76efc3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059335 Jul 29 07:01:48.399492 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1414/2864] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:48.776471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:48.777561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:48.787927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:48.788678 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:48.789713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:48.790381 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:48.816741 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:49.033092 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:49.047575 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-57591de4-4197-4bd4-91d5-0cd2053ba71a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1367 microversion: 2.1 time: 0.274766 Jul 29 07:01:49.048145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1451/2865] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:48 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:50.070404 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:50.071113 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:50.082900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:50.083359 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:50.084129 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:50.084589 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:50.266558 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:50.275329 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-14fe2186-efcb-4781-b226-e0b257e944b3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1367 microversion: 2.1 time: 0.209884 Jul 29 07:01:50.289425 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1415/2866] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:50 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:51.295913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:51.296527 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:51.303595 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:51.304042 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:51.304911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:51.305549 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:51.513896 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:51.526044 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b0e64492-34fb-48f5-b671-4fc4664dcbea tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1367 microversion: 2.1 time: 0.233699 Jul 29 07:01:51.526539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1452/2867] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:51 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:52.552887 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:52.553599 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:52.560814 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:52.563013 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:52.564040 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:52.564746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:52.798604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:52.810455 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-67ab54bd-7fd5-4f12-afec-bc301f13174f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1367 microversion: 2.1 time: 0.266924 Jul 29 07:01:52.811809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1416/2868] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:52 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:53.137400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-b5741e99-2780-4a07-9f4b-3d3bcd3a6cfd req-080610d4-eedd-48c6-a9ef-7d81ee9b95b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d", "name": "network-vif-plugged", "status": "completed", "tag": "d459d409-7ea5-4aea-abd8-293c2ac9f2d0"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:53.154242 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-b5741e99-2780-4a07-9f4b-3d3bcd3a6cfd req-080610d4-eedd-48c6-a9ef-7d81ee9b95b4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:53.154843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-b5741e99-2780-4a07-9f4b-3d3bcd3a6cfd req-080610d4-eedd-48c6-a9ef-7d81ee9b95b4 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:53.167803 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-b5741e99-2780-4a07-9f4b-3d3bcd3a6cfd req-080610d4-eedd-48c6-a9ef-7d81ee9b95b4 service nova] Creating event network-vif-plugged:d459d409-7ea5-4aea-abd8-293c2ac9f2d0 for instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d on hv-cinder-83482 Jul 29 07:01:53.173856 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-b5741e99-2780-4a07-9f4b-3d3bcd3a6cfd req-080610d4-eedd-48c6-a9ef-7d81ee9b95b4 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.242384 Jul 29 07:01:53.174984 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1453/2869] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 07:01:53.834168 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:53.835431 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:53.838461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:53.846075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:53.846845 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:53.847819 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:53.848641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:53.853800 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:54.004959 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:54.008153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:54.015594 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-b79fadf5-4f13-4fac-90ad-f3b8d0e4ee7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1367 microversion: 2.1 time: 0.185947 Jul 29 07:01:54.016686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1417/2870] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:53 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:54.671888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:54.672782 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:54.678234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-402c8e6c-c523-46b3-a805-6ae4750883c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Action: 'create', calling method: .version_select at 0x7f1459abd790>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-475371402", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkmI/OJrRHgFLmVoLf3Shnlw+w5zBqPHe5b9daywEnLSVDtu4vVbDFqjm/uRxiy653ZgwGSaUPkSB2muvvzEYQgytSR6/EtfFlmQUpln+ppY+LkcTuOCBT9Yu86zGft4w=="}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:54.683336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:01:54.699736 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-402c8e6c-c523-46b3-a805-6ae4750883c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Getting quotas for project 387f03d497884045b998a6f788991e18. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:01:54.704688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-402c8e6c-c523-46b3-a805-6ae4750883c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Getting quotas for user 13af20e11c9449fd807eeeb1b3ff898f and project 387f03d497884045b998a6f788991e18. Resources: {'key_pairs'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:01:54.731587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-402c8e6c-c523-46b3-a805-6ae4750883c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.060523 Jul 29 07:01:54.732468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1454/2871] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 07:01:54 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:01:54.835503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1409884893", "imageRef": "03afc6cb-1563-44fa-b45c-693a724ef0d5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-475371402", "networks": [{"uuid": "9e934f98-ec67-448f-b040-fd5ecf06fa81"}]}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:54.889194 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] validate_networks() for [('9e934f98-ec67-448f-b040-fd5ecf06fa81', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 07:01:55.039519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:55.053599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:55.061510 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:55.062048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:55.063116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:55.063695 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:55.224003 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:55.231734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-466f41c4-76b5-441e-a9c9-9ae7e450ff7b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1556 microversion: 2.1 time: 0.197764 Jul 29 07:01:55.232305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1455/2872] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:55 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1556 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:01:55.252104 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:55.252625 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:55.259377 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:55.259833 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:55.260639 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:55.261086 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:55.344199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9c0f4334-4f91-4e21-9b30-ee870647d668 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096029 Jul 29 07:01:55.351518 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1456/2873] 10.222.0.33 () {58 vars in 1275 bytes} [Fri Jul 29 07:01:55 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 07:01:55.412917 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 07:01:55.413335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 07:01:55.413804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 07:01:55.414207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 07:01:55.414615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 07:01:55.423357 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:55.423798 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:55.425139 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:55.425782 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:55.442985 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Getting quotas for project 387f03d497884045b998a6f788991e18. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:01:55.446849 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Getting quotas for user 13af20e11c9449fd807eeeb1b3ff898f and project 387f03d497884045b998a6f788991e18. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:01:55.457700 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 07:01:55.459874 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='03afc6cb-1563-44fa-b45c-693a724ef0d5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 07:01:55.502102 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR oslo.messaging._drivers.impl_rabbit [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [9b8f0a11-9426-411d-b042-4f1f15e5144c] AMQP server on 10.222.0.33:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 07:01:56.285141 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-059b5dad-1a60-49f3-8a41-d08f0e5b84ad req-eac59118-adfd-4036-96ce-ea0710855edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d", "tag": "d459d409-7ea5-4aea-abd8-293c2ac9f2d0"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:01:56.295322 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-059b5dad-1a60-49f3-8a41-d08f0e5b84ad req-eac59118-adfd-4036-96ce-ea0710855edc service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:56.295775 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-059b5dad-1a60-49f3-8a41-d08f0e5b84ad req-eac59118-adfd-4036-96ce-ea0710855edc service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:56.313199 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-059b5dad-1a60-49f3-8a41-d08f0e5b84ad req-eac59118-adfd-4036-96ce-ea0710855edc service nova] Creating event network-changed:d459d409-7ea5-4aea-abd8-293c2ac9f2d0 for instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d on hv-cinder-83482 Jul 29 07:01:56.317680 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-059b5dad-1a60-49f3-8a41-d08f0e5b84ad req-eac59118-adfd-4036-96ce-ea0710855edc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037402 Jul 29 07:01:56.318290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1457/2874] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 07:01:56.511505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [9b8f0a11-9426-411d-b042-4f1f15e5144c] Reconnected to AMQP server on 10.222.0.33:5672 via [amqp] client with port 43736. Jul 29 07:01:56.516080 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-20fced71-a284-480c-873a-d6f91d780fbd tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.684400 Jul 29 07:01:56.516893 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1418/2875] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 07:01:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 07:01:56.530879 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-634c9824-a0b9-41a5-9232-36a4fb0ed5c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:56.531810 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-634c9824-a0b9-41a5-9232-36a4fb0ed5c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:56.620925 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-634c9824-a0b9-41a5-9232-36a4fb0ed5c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:56.632330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-634c9824-a0b9-41a5-9232-36a4fb0ed5c7 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1258 microversion: 2.1 time: 0.106212 Jul 29 07:01:56.641311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1458/2876] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:56 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1258 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:57.655253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:57.656533 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:57.669624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:57.671370 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:57.672407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:57.672938 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:57.746998 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:57.757727 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-6e50083b-426a-4925-afce-55cacf7d8426 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1316 microversion: 2.1 time: 0.107134 Jul 29 07:01:57.759326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1419/2877] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:57 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1316 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:01:58.783743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:01:58.786530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:01:58.807547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:58.808643 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:58.816922 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:01:58.818423 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:01:59.153638 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:01:59.164029 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f953d657-09a1-4e21-91c9-06e406f1a00e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.385401 Jul 29 07:01:59.172963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1459/2878] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:01:58 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:00.106308 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-3542416d-4566-4f15-99a8-69f41aab7e0f req-346e29a4-dc73-4221-b03e-fc82573b2344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:00.118493 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3542416d-4566-4f15-99a8-69f41aab7e0f req-346e29a4-dc73-4221-b03e-fc82573b2344 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:00.119210 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-3542416d-4566-4f15-99a8-69f41aab7e0f req-346e29a4-dc73-4221-b03e-fc82573b2344 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:00.140034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-3542416d-4566-4f15-99a8-69f41aab7e0f req-346e29a4-dc73-4221-b03e-fc82573b2344 service nova] Creating event network-changed:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:02:00.151674 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-3542416d-4566-4f15-99a8-69f41aab7e0f req-346e29a4-dc73-4221-b03e-fc82573b2344 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044935 Jul 29 07:02:00.152864 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1420/2879] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:00.188482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:00.189330 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:00.199463 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:00.200489 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:00.201610 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:00.202318 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:00.414015 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:00.422934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-653f882e-a0c7-427d-a550-b0dfe9760436 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.240389 Jul 29 07:02:00.424048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1460/2880] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:00 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:01.448072 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:01.448903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:01.468164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:01.468657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:01.469635 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:01.470092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:01.656637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:01.665494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7791c55c-b337-4e80-afed-c39c07418a95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.222718 Jul 29 07:02:01.666654 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1421/2881] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:01 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:02.687783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:02.688572 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:02.696750 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:02.697292 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:02.698144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:02.698677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:02.848435 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:02.856722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0ce3d295-ecc9-439e-9591-e772c9a39c0e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.173209 Jul 29 07:02:02.861051 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1461/2882] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:02 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:03.879239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:03.879869 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:03.886571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:03.887024 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:03.887786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:03.888248 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:04.051495 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:04.060412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e65a061d-7237-4e22-b4a0-fc8cb4f988f6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.184897 Jul 29 07:02:04.060900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1422/2883] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:03 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:05.081767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:05.082392 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:05.089308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:05.089755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:05.090712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:05.091151 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:05.222560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:05.229955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fff3b8a3-51a9-4450-bbb7-3d4833869bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.152141 Jul 29 07:02:05.230718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1462/2884] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:05 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:06.250979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:06.251749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:06.254529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:06.255240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:06.261811 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:06.262298 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:06.263136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:06.263609 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:06.407810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:06.417153 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-54a57bf6-946e-48e0-8d86-64153caf713e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.170319 Jul 29 07:02:06.417816 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1423/2885] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:06 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:07.438440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:07.439105 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:07.442306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:07.447776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:07.448223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:07.449000 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:07.449440 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:07.580951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:07.588743 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-71955d39-1c9e-44e5-9808-43812362c088 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.154091 Jul 29 07:02:07.589311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1463/2886] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:07 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:08.609691 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:08.610306 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:08.617383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:08.617836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:08.618596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:08.619031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:08.769730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:08.777174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-53d9f00c-ce0f-4927-855c-8e53db58f990 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.171455 Jul 29 07:02:08.777732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1424/2887] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:08 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:02:09.799599 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:09.801108 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:09.809996 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:09.810828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:09.812250 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:09.813180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:09.947900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:09.956103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-835eb605-f1a2-4e19-8700-9e06e3bddaa3 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.160573 Jul 29 07:02:09.956748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1464/2888] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:09 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:10.979523 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:10.980141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:10.987541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:10.987967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:10.989603 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:10.990044 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:11.127784 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:11.135519 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f741d717-dae2-4350-a8e3-be07b2a50b95 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.159816 Jul 29 07:02:11.136084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1425/2889] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:10 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:12.156830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:12.157742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:12.164460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:12.164985 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:12.165761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:12.166205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:12.296794 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:12.304763 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c860c701-a7c5-47df-9bdc-0196c7d1b59f tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.151624 Jul 29 07:02:12.305445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1465/2890] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:12 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:13.074238 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-bb8d02f3-c933-45ba-9ec0-c80f409f34bc req-8111f0f4-7958-452d-9681-e48e9763d2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "name": "network-vif-plugged", "status": "completed", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:13.086313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-bb8d02f3-c933-45ba-9ec0-c80f409f34bc req-8111f0f4-7958-452d-9681-e48e9763d2fa service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:13.086839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-bb8d02f3-c933-45ba-9ec0-c80f409f34bc req-8111f0f4-7958-452d-9681-e48e9763d2fa service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:13.099192 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-bb8d02f3-c933-45ba-9ec0-c80f409f34bc req-8111f0f4-7958-452d-9681-e48e9763d2fa service nova] Creating event network-vif-plugged:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:02:13.104564 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-bb8d02f3-c933-45ba-9ec0-c80f409f34bc req-8111f0f4-7958-452d-9681-e48e9763d2fa service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034521 Jul 29 07:02:13.105302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1426/2891] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:13.326716 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:13.327911 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:13.335397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:13.335846 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:13.336672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:13.337109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:13.588294 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:13.595991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d19ed263-b486-415b-aa92-b1847d78bd83 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.273374 Jul 29 07:02:13.597089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1466/2892] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:13 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:14.620505 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:14.621930 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:14.636848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:14.637989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:14.639006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:14.639617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:15.128598 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:15.136565 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-18ad2bec-b5d5-414b-bee8-217d6ee98423 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1358 microversion: 2.1 time: 0.521200 Jul 29 07:02:15.139058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1427/2893] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:14 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1358 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:16.160016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:16.160601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:16.167545 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.168007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.168817 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.169269 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.313167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:16.324962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b72d9b51-b446-4cf0-b6b0-36c542b0d365 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1548 microversion: 2.1 time: 0.169101 Jul 29 07:02:16.325979 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1467/2894] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:16 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:16.347350 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:16.348711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:16.356639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.357398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.358373 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.358987 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.622810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:16.635326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-808b4248-38ee-43af-819a-b3c0c3031a23 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1548 microversion: 2.1 time: 0.292281 Jul 29 07:02:16.636507 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1428/2895] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:16 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1548 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:16.657467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:16.663088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:16.664222 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Searching by: {'deleted': False, 'project_id': '387f03d497884045b998a6f788991e18'} {{(pid=117958) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 07:02:16.675439 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.675906 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.676787 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.677558 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.779397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.multi_cell_list [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117958) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 07:02:16.889348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-466788ed-634d-44ac-ab50-c8654e734834 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.237185 Jul 29 07:02:16.890223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1468/2896] 10.222.0.33 () {58 vars in 1125 bytes} [Fri Jul 29 07:02:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:16.901405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:16.902019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:16.909362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.909981 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:16.910950 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:16.911578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:17.053337 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:17.061091 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-918721da-3be6-4ffc-81a4-25a1b62f0bc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1548 microversion: 2.1 time: 0.163256 Jul 29 07:02:17.061675 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1429/2897] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:16 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:18.708622 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be68dd19-bfe8-435f-b93f-107567310f9c"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:18.710927 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:18.724587 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:18.725343 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:18.726362 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:18.726853 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:18.914144 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=91 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:19.052991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-462c56d8-566a-4c5f-9a5b-3b6a9ddcfdf1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.349406 Jul 29 07:02:19.054679 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1469/2898] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 07:02:18 2022] POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments => generated 194 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:22.450271 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a8019db5-c419-4a10-990d-427186396f0b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Action: 'create', calling method: .version_select at 0x7f145e2aaca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-117779030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqU8YdAhGewH4oo5EvFTdj4dqNUzdAZXLji/T0jCCdU04xk2l8rmIqaaU48yt0x2w3jOxMs5EVUQfuf6R/OnvmkH1vt9dycBWPb6kQ2qa1xrUeZDh4tpdj+EEZIizi37g=="}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:22.466116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-a8019db5-c419-4a10-990d-427186396f0b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:02:22.470380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-a8019db5-c419-4a10-990d-427186396f0b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for user f0f388a7fdbc4925940a5e1a53f15f9e and project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'key_pairs'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:02:22.494655 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a8019db5-c419-4a10-990d-427186396f0b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.218384 Jul 29 07:02:22.495261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1430/2899] 10.222.0.33 () {60 vars in 1159 bytes} [Fri Jul 29 07:02:22 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:25.728814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:25.729675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:25.732493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:25.739591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:25.740046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:25.740871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:25.741306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:25.889808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:25.898887 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9d17b2a0-74dc-4d05-a984-01adae94bf2e tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1594 microversion: 2.1 time: 0.174246 Jul 29 07:02:25.904091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1470/2900] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:25 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:28.043001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=65 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:28.119494 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-82c9487b-982a-418d-a319-771f91c33e67 req-46131064-75a1-480f-8155-0fe3a0aa446f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:28.134056 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=4 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:28.150252 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-82c9487b-982a-418d-a319-771f91c33e67 req-46131064-75a1-480f-8155-0fe3a0aa446f service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:28.150779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-82c9487b-982a-418d-a319-771f91c33e67 req-46131064-75a1-480f-8155-0fe3a0aa446f service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:28.177945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-82c9487b-982a-418d-a319-771f91c33e67 req-46131064-75a1-480f-8155-0fe3a0aa446f service nova] Creating event network-changed:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:02:28.183876 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-82c9487b-982a-418d-a319-771f91c33e67 req-46131064-75a1-480f-8155-0fe3a0aa446f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146042 Jul 29 07:02:28.184935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1431/2901] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:29.189862 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-772389665"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:29.190664 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:29.193944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:29.203552 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:29.204138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:29.205079 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:29.205807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:29.409167 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.network.security_group_api [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Adding security group 0ccd8aa2-7927-45b9-95f8-ae3c9c529b90 to port 81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 Jul 29 07:02:29.776795 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0ef2b95f-487a-4775-97bb-391e0c7c8aa6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.591045 Jul 29 07:02:29.777873 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1471/2902] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 07:02:29 2022] POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:02:29.793092 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:29.794189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:29.798669 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-e458ff17-a1ac-40ba-b82d-d6484fe64c22 req-3c2a4d4f-e9cc-4c98-a98b-44b541b19009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:29.811830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:29.812793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:29.814989 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:29.816947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:29.820807 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e458ff17-a1ac-40ba-b82d-d6484fe64c22 req-3c2a4d4f-e9cc-4c98-a98b-44b541b19009 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:29.822785 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-e458ff17-a1ac-40ba-b82d-d6484fe64c22 req-3c2a4d4f-e9cc-4c98-a98b-44b541b19009 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:29.839845 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-e458ff17-a1ac-40ba-b82d-d6484fe64c22 req-3c2a4d4f-e9cc-4c98-a98b-44b541b19009 service nova] Creating event network-changed:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:02:29.845813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-e458ff17-a1ac-40ba-b82d-d6484fe64c22 req-3c2a4d4f-e9cc-4c98-a98b-44b541b19009 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055439 Jul 29 07:02:29.846480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1472/2903] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:30.080487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:30.092006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-65298bee-140d-4b64-b828-6b42a7d6e90c tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1759 microversion: 2.1 time: 0.306617 Jul 29 07:02:30.105326 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1432/2904] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:29 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1759 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:32.614564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:32.615134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:32.621576 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:32.627078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:32.627078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:32.627078 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:32.650333 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-45190af5-bbf4-4577-a44e-be0e7fd2be3b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/ips" status: 200 len: 149 microversion: 2.1 time: 0.041166 Jul 29 07:02:32.650910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1473/2905] 10.222.0.33 () {58 vars in 1248 bytes} [Fri Jul 29 07:02:32 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:33.998073 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be63bf87-0e7a-442a-8859-e6d6b47fba1f"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:34.000472 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:34.002905 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=4 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:34.009048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:34.009498 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:34.010293 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:34.010729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:34.306106 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-7b221a02-ae46-4a08-ba3d-ed5233041a6f tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "POST /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311118 Jul 29 07:02:34.312064 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1433/2906] 10.222.0.33 () {60 vars in 1323 bytes} [Fri Jul 29 07:02:33 2022] POST /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:38.835799 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-357968067", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-117779030", "security_groups": [{"name": "tempest-secgroup-smoke-1337002113"}], "block_device_mapping_v2": [{"uuid": "d0a04565-cec1-4d99-b430-4b8283bde7fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6187da0-c360-4dba-bc42-2501aeb4ec7a"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:38.947715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] validate_networks() for [('b6187da0-c360-4dba-bc42-2501aeb4ec7a', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 07:02:39.309034 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 07:02:39.309458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 07:02:39.309932 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 07:02:39.310345 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 07:02:39.310761 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 07:02:39.320438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:39.320914 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:39.321713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:39.322148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:39.339632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:02:39.343685 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for user f0f388a7fdbc4925940a5e1a53f15f9e and project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:02:39.399370 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 07:02:39.401536 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0a04565-cec1-4d99-b430-4b8283bde7fb',volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 07:02:39.527734 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d5b8e332-7455-4a17-89e6-7a35ca417a62 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.695878 Jul 29 07:02:39.528969 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1474/2907] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 07:02:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 07:02:39.543485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-57afe4ff-fc5e-4a28-b62b-2be7c127315d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:39.544790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-57afe4ff-fc5e-4a28-b62b-2be7c127315d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:39.604198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-57afe4ff-fc5e-4a28-b62b-2be7c127315d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:39.610909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-57afe4ff-fc5e-4a28-b62b-2be7c127315d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1093 microversion: 2.1 time: 0.072912 Jul 29 07:02:39.611723 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1434/2908] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:39 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:40.632424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:40.633070 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:40.640722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:40.641248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:40.642302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:40.642778 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:40.709555 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:40.717206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-142e3693-5372-40f0-8b9e-b9a03f7c4b99 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1191 microversion: 2.1 time: 0.089838 Jul 29 07:02:40.717825 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1475/2909] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:40 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:41.739853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:41.741015 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:41.749378 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:41.749836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:41.750673 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:41.751116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:41.902407 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:41.910760 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a5f81a3b-09e9-4ebd-99e1-677e6d066eee tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.175851 Jul 29 07:02:41.912578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1435/2910] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:41 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:02:41.993325 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:41.994601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:42.001248 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.001926 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:42.002698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.003137 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:42.085905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lazy-loading 'services' on Instance uuid 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:02:42.174185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-375d112f-7965-44e0-b5da-d1b474a66928 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments/be63bf87-0e7a-442a-8859-e6d6b47fba1f" status: 202 len: 0 microversion: 2.1 time: 0.185632 Jul 29 07:02:42.174700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1476/2911] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 07:02:41 2022] DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments/be63bf87-0e7a-442a-8859-e6d6b47fba1f => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:02:42.184290 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:42.186822 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:42.194183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.194641 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:42.195420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.196356 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:42.230120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c65d4126-300d-4b11-99a8-7d98d02bf559 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049966 Jul 29 07:02:42.235094 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1436/2912] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 07:02:42 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:42.435515 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-99e0f4b5-fadd-445d-9243-0166cf1b417f req-e907a376-95a8-4e92-b553-658603d9bbba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a2da8-41c5-4194-a31a-81e34f574fcc", "tag": "8c4cccca-01e9-4ed3-ad18-29af61cf4081"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:42.448427 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-99e0f4b5-fadd-445d-9243-0166cf1b417f req-e907a376-95a8-4e92-b553-658603d9bbba service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.449071 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-99e0f4b5-fadd-445d-9243-0166cf1b417f req-e907a376-95a8-4e92-b553-658603d9bbba service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:42.461902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-99e0f4b5-fadd-445d-9243-0166cf1b417f req-e907a376-95a8-4e92-b553-658603d9bbba service nova] Creating event network-changed:8c4cccca-01e9-4ed3-ad18-29af61cf4081 for instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc on hv-cinder-83482 Jul 29 07:02:42.467299 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-99e0f4b5-fadd-445d-9243-0166cf1b417f req-e907a376-95a8-4e92-b553-658603d9bbba service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036541 Jul 29 07:02:42.467963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1477/2913] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:42.936471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:42.937098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:42.944411 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.945008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:42.945787 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:42.946219 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.080846 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:43.089207 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-af87664d-dc3c-4fca-8cc0-a45a2084b773 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.157582 Jul 29 07:02:43.089773 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1437/2914] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:42 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:43.243904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:43.246171 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:43.252855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:43.253313 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.254081 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:43.254521 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.283519 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-4409138c-a6da-484f-bbde-ac0c1d8032e0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044570 Jul 29 07:02:43.284075 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1478/2915] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 07:02:43 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 07:02:43.346806 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:43.347301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:43.353282 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:43.353733 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.354489 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:43.354927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.379229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:02:43.453570 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-29ab169f-5be3-44a8-9ece-881c1b40f1f0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 204 len: 0 microversion: 2.1 time: 0.110084 Jul 29 07:02:43.454444 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1438/2916] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:02:43 2022] DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 07:02:43.463829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:43.464557 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:43.470560 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:43.471014 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.471771 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:43.472213 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:43.601207 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:43.608619 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59fbcd06-9797-4bfe-b581-c9ffeacadcd3 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1681 microversion: 2.1 time: 0.148886 Jul 29 07:02:43.609184 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1479/2917] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:43 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1681 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:44.110490 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:44.111186 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:44.118383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:44.118830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:44.119578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:44.120007 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:44.251895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:44.260098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-71df20dc-cf64-4086-99bf-8c7b2a355976 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.153850 Jul 29 07:02:44.260710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1439/2918] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:44 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:44.631413 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:44.632027 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:44.638530 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:44.638971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:44.639715 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:44.640146 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:44.775462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:44.782784 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fc8d2111-060d-4f2c-b9d4-5efbc49c631a tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1681 microversion: 2.1 time: 0.156521 Jul 29 07:02:44.783336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1480/2919] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:44 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:45.281346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:45.282118 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:45.289954 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:45.290412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:45.291318 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:45.291763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:45.439335 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:45.447957 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8eb43684-7697-4685-8b7a-8b2c36939c05 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.170493 Jul 29 07:02:45.448563 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1440/2920] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:45 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:45.805274 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:45.806057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:45.812776 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:45.813234 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:45.813995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:45.814425 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:45.897607 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12a751b41fd546ac9017c67d6de4ebdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10b54d7ff9644981893f886e59f22021', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:45.904933 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-05052d1c-4d18-4435-b146-5a481307fcf0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 200 len: 1613 microversion: 2.1 time: 0.105112 Jul 29 07:02:45.916713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1481/2921] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:45 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 1613 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:46.084254 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-dcf7911a-642c-4000-9848-c72f32c5dff9 req-930f9610-b55d-4013-a814-e9f3af99000a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d", "name": "network-vif-deleted", "tag": "d459d409-7ea5-4aea-abd8-293c2ac9f2d0"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:46.096126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-dcf7911a-642c-4000-9848-c72f32c5dff9 req-930f9610-b55d-4013-a814-e9f3af99000a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:46.096604 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-dcf7911a-642c-4000-9848-c72f32c5dff9 req-930f9610-b55d-4013-a814-e9f3af99000a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:46.109732 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-dcf7911a-642c-4000-9848-c72f32c5dff9 req-930f9610-b55d-4013-a814-e9f3af99000a service nova] Creating event network-vif-deleted:d459d409-7ea5-4aea-abd8-293c2ac9f2d0 for instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d on hv-cinder-83482 Jul 29 07:02:46.116755 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-dcf7911a-642c-4000-9848-c72f32c5dff9 req-930f9610-b55d-4013-a814-e9f3af99000a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Jul 29 07:02:46.117592 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1441/2922] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:46.467900 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:46.468651 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:46.476331 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:46.476885 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:46.477792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:46.478297 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:46.627963 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:46.637198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a457e1da-2138-43e3-8be4-f2d3345d17e9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.173058 Jul 29 07:02:46.638065 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1482/2923] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:46 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:46.927818 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:46.928459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:46.934943 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:46.935401 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:46.936165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:46.936628 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:46.950269 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d HTTP/1.1 Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:02:46.951935 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:46.953804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d'} Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:46.954848 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:46.956680 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:46.958325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:46.958325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cce0ee8e-f21b-4754-b686-38b59340a729 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 404 len: 111 microversion: 2.1 time: 0.030471 Jul 29 07:02:46.958325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1442/2924] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:46 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:02:46.962119 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-636e8d8e-be3e-4b9f-a66e-4f5d8d0fc649 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '.version_select at 0x7f145994c550>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:46.981732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-636e8d8e-be3e-4b9f-a66e-4f5d8d0fc649 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445247549" status: 202 len: 0 microversion: 2.1 time: 0.023391 Jul 29 07:02:46.982308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1483/2925] 10.222.0.33 () {58 vars in 1218 bytes} [Fri Jul 29 07:02:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445247549 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:02:47.660692 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:47.661321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:47.667288 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:47.667742 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:47.668491 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:47.668944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:47.805281 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:47.812823 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-084b240c-1c88-4659-b94b-467cedaa3859 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.157296 Jul 29 07:02:47.813383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1443/2926] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:47 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:48.713923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:48.714438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:48.721432 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:48.721886 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:48.722656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:48.723099 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:48.737058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d HTTP/1.1 Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:02:48.738759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.741168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d'} Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:48.742180 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.743974 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.745712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:48.745712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b06529c0-2d82-4fe2-9256-eb1ff7c7527b tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 404 len: 111 microversion: 2.1 time: 0.031532 Jul 29 07:02:48.745712 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1484/2927] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:02:48 2022] DELETE /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:02:48.750183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:48.750804 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:48.757256 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:48.757711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:48.758475 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:48.758921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:48.772003 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d HTTP/1.1 Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:02:48.773541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.775315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d'} Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:48.776321 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. Jul 29 07:02:48.777992 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:48.779497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance 6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:48.779497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a510f60f-0047-49c4-9241-f2ea59489f3e tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d" status: 404 len: 111 microversion: 2.1 time: 0.028730 Jul 29 07:02:48.779497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1444/2928] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:48 2022] GET /compute/v2.1/servers/6ddd39d2-263d-46b7-a9d1-790a4d7d0f2d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:02:48.835270 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:48.835883 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:48.842369 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:48.842823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:48.843621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:48.844062 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:48.979366 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:48.981659 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=76,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:48.988687 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b5df2df6-dacd-40db-83fc-2a1230c692dd tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.157684 Jul 29 07:02:48.989259 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1485/2929] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:48 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:49.913435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:49.913920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:49.915944 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:49.922105 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:49.922551 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:49.923300 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:49.923729 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:49.937572 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 HTTP/1.1 Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:02:49.939141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.940920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '03e3e04c-6b78-4435-bdd9-23e80b507cd5'} Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:49.941945 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.943347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.946115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:49.946115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-207e0bf8-6744-440c-a333-d3f37fe33d40 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 404 len: 111 microversion: 2.1 time: 0.030989 Jul 29 07:02:49.946115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1445/2930] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:02:49 2022] DELETE /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:02:49.950176 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:49.950792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: 03e3e04c-6b78-4435-bdd9-23e80b507cd5] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:49.952962 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:49.953601 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:49.961228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:49.961683 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:49.962445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:49.963149 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:49.976753 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 HTTP/1.1 Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:02:49.978254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.980028 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '03e3e04c-6b78-4435-bdd9-23e80b507cd5'} Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:49.981046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. Jul 29 07:02:49.982672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:02:49.984134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance 03e3e04c-6b78-4435-bdd9-23e80b507cd5 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:49.984134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-06c519d0-9903-480b-9451-17e251fa8832 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5" status: 404 len: 111 microversion: 2.1 time: 0.033292 Jul 29 07:02:49.984134 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1486/2931] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:49 2022] GET /compute/v2.1/servers/03e3e04c-6b78-4435-bdd9-23e80b507cd5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:02:49.989058 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:49.990066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:49.996676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:49.997124 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:49.997901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:49.998332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:50.009747 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:50.010358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:50.013202 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 HTTP/1.1 Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:02:50.014781 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.016497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'c87e0f8d-3a0a-43db-88ba-36ac438e5660'} Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:50.017481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.019070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.020707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:50.020707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cb22eb09-c6fc-4361-8e98-1bca779299b0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "DELETE /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 404 len: 111 microversion: 2.1 time: 0.031085 Jul 29 07:02:50.020707 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1446/2932] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:02:49 2022] DELETE /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:02:50.020991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:50.020991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:50.020991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:50.020991 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:50.024799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:50.025412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] [instance: c87e0f8d-3a0a-43db-88ba-36ac438e5660] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:50.031220 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:50.031672 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:50.032426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:50.032900 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:50.047188 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] HTTP exception thrown: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Request method failure captured: Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 HTTP/1.1 Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44PvlccwfImumpXS2hwsQLZvE8bSUbBy_4eZUSYNiv7rGm0nfv9rDkD7nInETRTzVICgCVUGeeClPqXhGGM3ztnQN10IN6vxo5i4IUG9i08j8sd8gJOXHcdelx0yYuz7lWLRRweoPSRD-3aa8oPS7zRh3HaRZH6cpKC4DfMQ3jSb2PI Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:02:50.048743 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/10b54d7ff9644981893f886e59f22021"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_10b54d7ff9644981893f886e59f22021", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/10b54d7ff9644981893f886e59f22021"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 10b54d7ff9644981893f886e59f22021 Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2117191414 Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 12a751b41fd546ac9017c67d6de4ebdd Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeNegativeTest-2117191414-project Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.050547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'c87e0f8d-3a0a-43db-88ba-36ac438e5660'} Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:02:50.051538 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. Jul 29 07:02:50.054435 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:02:50.056070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] Returning 404 to user: Instance c87e0f8d-3a0a-43db-88ba-36ac438e5660 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:02:50.056070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a84264b9-b1e5-46bf-b241-a5ec6782b4c0 tempest-AttachVolumeNegativeTest-2117191414 tempest-AttachVolumeNegativeTest-2117191414-project] 10.222.0.33 "GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660" status: 404 len: 111 microversion: 2.1 time: 0.029562 Jul 29 07:02:50.056070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1447/2933] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:50 2022] GET /compute/v2.1/servers/c87e0f8d-3a0a-43db-88ba-36ac438e5660 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 07:02:50.153437 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:50.165431 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-0896e953-c3b1-4721-ae33-90f919f56fcc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.160038 Jul 29 07:02:50.166004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1487/2934] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:50 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:02:51.186605 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:51.187840 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:51.195166 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:51.195624 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:51.197077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:51.197517 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:51.422830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:51.430937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-0a73e887-d28f-460e-b02c-178ff722eba8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.248413 Jul 29 07:02:51.431499 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1448/2935] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:51 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:52.452004 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:52.452645 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:52.460608 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:52.461100 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:52.461869 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:52.462304 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:52.661449 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:52.681591 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:52.698700 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e2a729f7-d6be-4bf3-9764-457088aa54d3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.250503 Jul 29 07:02:52.699492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1488/2936] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:52 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:52.711447 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:52.733825 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:52.735110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:52.736075 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:52.736927 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:52.810416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:52.850433 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-75d99528-08f8-4a5c-8c6a-c1805b14ce1d tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.193757 Jul 29 07:02:52.851083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1449/2937] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 07:02:52 2022] POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 07:02:52.863257 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:52.863945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:52.872429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:52.873063 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:52.873910 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:52.874626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:53.127574 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:53.139334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3ec0d3b0-ffff-4560-a605-71ed7438b5d4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1751 microversion: 2.1 time: 0.283755 Jul 29 07:02:53.141026 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1489/2938] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:52 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1751 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:53.402457 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-10759687-b3cc-4369-b801-ed9f74ce9712 req-192c8596-67c2-4391-99df-4ad8aead9107 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a2da8-41c5-4194-a31a-81e34f574fcc", "name": "network-vif-plugged", "status": "completed", "tag": "8c4cccca-01e9-4ed3-ad18-29af61cf4081"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:53.414083 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-10759687-b3cc-4369-b801-ed9f74ce9712 req-192c8596-67c2-4391-99df-4ad8aead9107 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:53.414711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-10759687-b3cc-4369-b801-ed9f74ce9712 req-192c8596-67c2-4391-99df-4ad8aead9107 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:53.431722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-10759687-b3cc-4369-b801-ed9f74ce9712 req-192c8596-67c2-4391-99df-4ad8aead9107 service nova] Creating event network-vif-plugged:8c4cccca-01e9-4ed3-ad18-29af61cf4081 for instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc on hv-cinder-83482 Jul 29 07:02:53.437422 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-10759687-b3cc-4369-b801-ed9f74ce9712 req-192c8596-67c2-4391-99df-4ad8aead9107 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039374 Jul 29 07:02:53.438167 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1450/2939] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:53.719384 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:53.720006 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:53.727479 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:53.728189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:53.729221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:53.729666 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:53.911592 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:53.919636 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3c7737af-f5af-41d2-b562-a0aa88d777b0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1265 microversion: 2.1 time: 0.204040 Jul 29 07:02:53.920271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1490/2940] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:53 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:54.167514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:54.168135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:54.174212 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:54.174660 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:54.175413 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:54.175847 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:54.335143 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:54.344183 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-f9fc0de0-51f9-49b6-bf58-57aa81ff6de1 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.181298 Jul 29 07:02:54.345081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1451/2941] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:54 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:54.941085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:54.942091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:54.949732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:54.950112 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:54.950889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:54.951334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:55.089809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:55.097357 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3465c814-f8ee-46c0-a9dc-998a15941174 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1451 microversion: 2.1 time: 0.160188 Jul 29 07:02:55.097920 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1491/2942] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:54 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:55.118405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:55.119048 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:55.125659 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:55.126104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:55.126862 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:55.127295 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:55.284066 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:55.294451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-dc957e3b-2c1f-4adb-bb9f-55842b54de6b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1451 microversion: 2.1 time: 0.180504 Jul 29 07:02:55.295100 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1452/2943] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:55 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1451 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:55.367948 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:55.369458 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:55.379483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:55.379957 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:55.381728 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:55.382348 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:55.556897 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:55.565351 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-facb306d-423b-4b4f-b808-bc498d782ab4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.202538 Jul 29 07:02:55.565928 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1492/2944] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:55 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:56.588734 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:56.589380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:56.595850 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:56.596302 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:56.597104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:56.597545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:56.898772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:56.908237 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e75d4e44-75c8-4bf1-977d-2b61c5ceec07 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.324788 Jul 29 07:02:56.908839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1453/2945] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:56 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:57.724326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-ac0b65e2-ae95-4ccc-a7a3-074f49169103 req-cd77c111-7781-4ee5-9850-e6735d66839a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d9a2da8-41c5-4194-a31a-81e34f574fcc", "tag": "8c4cccca-01e9-4ed3-ad18-29af61cf4081"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:02:57.731143 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:02:57.736630 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ac0b65e2-ae95-4ccc-a7a3-074f49169103 req-cd77c111-7781-4ee5-9850-e6735d66839a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:57.737085 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-ac0b65e2-ae95-4ccc-a7a3-074f49169103 req-cd77c111-7781-4ee5-9850-e6735d66839a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:57.750797 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-ac0b65e2-ae95-4ccc-a7a3-074f49169103 req-cd77c111-7781-4ee5-9850-e6735d66839a service nova] Creating event network-changed:8c4cccca-01e9-4ed3-ad18-29af61cf4081 for instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc on hv-cinder-83482 Jul 29 07:02:57.756397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-ac0b65e2-ae95-4ccc-a7a3-074f49169103 req-cd77c111-7781-4ee5-9850-e6735d66839a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036734 Jul 29 07:02:57.757118 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1493/2946] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:02:57.935602 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:57.937299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:57.946801 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:57.947536 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:57.948529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:57.949521 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:58.205016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:58.216978 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a54977b4-3804-4325-84f8-8013604b53ea tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.288850 Jul 29 07:02:58.229361 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1454/2947] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:57 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:02:59.241954 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:02:59.243410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:02:59.250131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:59.250662 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:59.251642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:02:59.251955 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:02:59.401046 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:02:59.409001 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d896cec5-c5ec-412f-b5ba-e77e49e21dc6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.172121 Jul 29 07:02:59.409556 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1494/2948] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:02:59 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:03:00.432130 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:00.432766 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:00.435261 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:03:00.444529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:00.444529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:00.444529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:00.444529 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:00.600788 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:00.608740 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2e6900c3-aa53-486c-bd12-cb5237c4b3db tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.181429 Jul 29 07:03:00.609313 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1455/2949] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:00 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:01.631251 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:01.631958 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:01.638647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:01.639102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:01.639895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:01.640342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:01.784459 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:01.792729 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f9a9a87c-f875-471e-b7cf-bf0f8e2ce1cc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.165799 Jul 29 07:03:01.793289 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1495/2950] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:01 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:02.814132 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:02.814772 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:02.821881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:02.822331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:02.823104 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:02.823537 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:02.964967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:02.972834 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d15b2930-9700-45c3-9f35-9bf8ed2c79c4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.162482 Jul 29 07:03:02.973399 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1456/2951] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:02 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:03.994994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:03.995561 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:04.002054 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:04.002505 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:04.003261 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:04.003698 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:04.150235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:04.158117 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8296dc39-4f34-4db4-a2ab-ee85622e8586 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.167112 Jul 29 07:03:04.158704 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1496/2952] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:03 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:05.180504 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:05.181137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:05.187566 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:05.188012 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:05.188797 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:05.189232 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:05.327522 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:05.336738 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-5d7affb3-0f37-4c5f-8aa2-c8bb7efd13b4 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.160072 Jul 29 07:03:05.337364 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1457/2953] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:05 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:06.358923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:06.359540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:06.366195 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:06.366648 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:06.367411 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:06.367851 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:06.516755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:06.525870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d32c2b1f-8591-4a43-b776-0bee3986dbcc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1756 microversion: 2.1 time: 0.170789 Jul 29 07:03:06.526684 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1497/2954] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:06 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:07.547041 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:07.547689 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:07.554480 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:07.555037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:07.555908 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:07.556344 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:07.700471 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:07.708316 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-230db92d-1378-461c-b22a-4682acab721b tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1759 microversion: 2.1 time: 0.165152 Jul 29 07:03:07.709035 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1458/2955] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:07 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1759 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:46.109746 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-772389665"}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:03:46.110334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:46.113445 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=9 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:03:46.114127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=65 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:03:46.118744 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:46.127677 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:46.128508 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:46.129016 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:46.262699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.network.security_group_api [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Removing security group 0ccd8aa2-7927-45b9-95f8-ae3c9c529b90 from port 81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 Jul 29 07:03:46.615230 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d54b4ced-e439-439c-981b-b3fd18bf4615 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/action" status: 202 len: 0 microversion: 2.1 time: 0.509764 Jul 29 07:03:46.616838 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1498/2956] 10.222.0.33 () {60 vars in 1278 bytes} [Fri Jul 29 07:03:46 2022] POST /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:03:46.624063 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-4027c179-5f99-48e2-9786-34a57f447db3 req-91310fc0-e5c8-4b26-8d6d-acdba2f21a29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:03:46.637458 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=7 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:03:46.644211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:03:46.661937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-4027c179-5f99-48e2-9786-34a57f447db3 req-91310fc0-e5c8-4b26-8d6d-acdba2f21a29 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:46.667424 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-4027c179-5f99-48e2-9786-34a57f447db3 req-91310fc0-e5c8-4b26-8d6d-acdba2f21a29 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:46.695398 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-4027c179-5f99-48e2-9786-34a57f447db3 req-91310fc0-e5c8-4b26-8d6d-acdba2f21a29 service nova] Creating event network-changed:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:03:46.703870 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-4027c179-5f99-48e2-9786-34a57f447db3 req-91310fc0-e5c8-4b26-8d6d-acdba2f21a29 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084485 Jul 29 07:03:46.705440 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1459/2957] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:03:47.873430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:47.874052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:47.889726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:47.890175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:47.890938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:47.891372 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:47.981488 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lazy-loading 'services' on Instance uuid 4b750d4e-87fd-46be-9ea0-1c48973a6d5a {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:03:48.062946 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-db249803-f1b3-451a-91f6-fab11ea8a9ba tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments/be68dd19-bfe8-435f-b93f-107567310f9c" status: 202 len: 0 microversion: 2.1 time: 0.193550 Jul 29 07:03:48.066880 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1499/2958] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 07:03:47 2022] DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments/be68dd19-bfe8-435f-b93f-107567310f9c => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:03:48.075786 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:48.078348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:48.088233 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:48.088883 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:48.089973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:48.090578 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:48.127860 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-90ab1c21-18fb-4040-8cae-d6ff5e786644 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059175 Jul 29 07:03:48.128799 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1460/2959] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 07:03:48 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:03:48.719824 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-3236c956-a848-459a-85d5-e65356685741 req-a1780685-35b1-484e-a766-7fa6490e1e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:03:48.738424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3236c956-a848-459a-85d5-e65356685741 req-a1780685-35b1-484e-a766-7fa6490e1e7b service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:48.738870 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-3236c956-a848-459a-85d5-e65356685741 req-a1780685-35b1-484e-a766-7fa6490e1e7b service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:48.751181 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-3236c956-a848-459a-85d5-e65356685741 req-a1780685-35b1-484e-a766-7fa6490e1e7b service nova] Creating event network-changed:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:03:48.762156 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-3236c956-a848-459a-85d5-e65356685741 req-a1780685-35b1-484e-a766-7fa6490e1e7b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046422 Jul 29 07:03:48.762959 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1500/2960] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:03:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:03:49.140385 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:49.142756 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:49.150245 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:49.150730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:49.151718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:49.152161 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:49.183253 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1d033978-0582-4c71-b126-e31f859f0ff8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046748 Jul 29 07:03:49.183841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1461/2961] 10.222.0.33 () {58 vars in 1302 bytes} [Fri Jul 29 07:03:49 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 07:03:49.195402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:49.196069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:49.203395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:49.203934 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:49.204808 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:49.205308 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:49.287048 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] HTTP exception thrown: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a is not attached to volume be68dd19-bfe8-435f-b93f-107567310f9c Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Request method failure captured: Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments/be68dd19-bfe8-435f-b93f-107567310f9c HTTP/1.1 Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi44XNLRcfmsh1jj6KnjLvrCkO0DKxrnWYZIQ3YHOpqHgW79upwiNMYN9p54CGXUMKFH37hN-ALbZxToISucfEjjMtevkj7aV7oUq7By2SZ6AUY0qbe3cURjPzN-v0eBkNjN6vqRceltLktVJKk5AgB9qi-mBrHUYccD77hV_5jXnQLJc Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 387f03d497884045b998a6f788991e18 Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestMinimumBasicScenario-1019729650 Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:03:49.289528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/387f03d497884045b998a6f788991e18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/387f03d497884045b998a6f788991e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_387f03d497884045b998a6f788991e18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/387f03d497884045b998a6f788991e18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestMinimumBasicScenario-1019729650 Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 387f03d497884045b998a6f788991e18 Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1019729650 Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-TestMinimumBasicScenario-1019729650-project Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 13af20e11c9449fd807eeeb1b3ff898f Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestMinimumBasicScenario-1019729650-project Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:03:49.291478 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a is not attached to volume be68dd19-bfe8-435f-b93f-107567310f9c Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'server_id': '4b750d4e-87fd-46be-9ea0-1c48973a6d5a', 'id': 'be68dd19-bfe8-435f-b93f-107567310f9c'} Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id be68dd19-bfe8-435f-b93f-107567310f9c. Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:03:49.296132 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a is not attached to volume be68dd19-bfe8-435f-b93f-107567310f9c Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a is not attached to volume be68dd19-bfe8-435f-b93f-107567310f9c Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:03:49.297792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Returning 404 to user: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a is not attached to volume be68dd19-bfe8-435f-b93f-107567310f9c {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:03:49.299221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-9b38f9eb-b97c-4284-8a91-7f076182cbc8 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments/be68dd19-bfe8-435f-b93f-107567310f9c" status: 404 len: 154 microversion: 2.1 time: 0.100537 Jul 29 07:03:49.299221 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1501/2962] 10.222.0.33 () {58 vars in 1416 bytes} [Fri Jul 29 07:03:49 2022] DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a/os-volume_attachments/be68dd19-bfe8-435f-b93f-107567310f9c => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 07:03:50.480421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:50.480969 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:50.487397 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:50.487853 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:50.488644 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:50.489095 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:50.513941 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:03:50.588515 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-aa350c26-87f3-4ce9-86e0-d8670fd731ce tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 204 len: 0 microversion: 2.1 time: 0.110723 Jul 29 07:03:50.589222 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1462/2963] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:03:50 2022] DELETE /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 07:03:50.597841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:50.598444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:50.605584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:50.606032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:50.606783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:50.607215 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:50.987492 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:50.995041 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7e84418b-3ded-42cb-b5be-649728054ec6 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1554 microversion: 2.1 time: 0.401166 Jul 29 07:03:50.995604 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1502/2964] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:50 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1554 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:52.016412 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:52.017135 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:52.023633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:52.024832 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:52.025631 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:52.026070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:52.164211 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13af20e11c9449fd807eeeb1b3ff898f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f03d497884045b998a6f788991e18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:03:52.172875 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8f4e66a8-230f-4934-a8e2-05d27a8351e2 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 200 len: 1554 microversion: 2.1 time: 0.160645 Jul 29 07:03:52.173415 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1463/2965] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:52 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:03:52.732338 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-0342048d-0676-4c12-8ebf-f211dd3f727a req-ee421b8b-7d46-4379-8648-14b46b40a756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b750d4e-87fd-46be-9ea0-1c48973a6d5a", "name": "network-vif-deleted", "tag": "81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:03:52.747663 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0342048d-0676-4c12-8ebf-f211dd3f727a req-ee421b8b-7d46-4379-8648-14b46b40a756 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:52.748101 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-0342048d-0676-4c12-8ebf-f211dd3f727a req-ee421b8b-7d46-4379-8648-14b46b40a756 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:52.760848 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-0342048d-0676-4c12-8ebf-f211dd3f727a req-ee421b8b-7d46-4379-8648-14b46b40a756 service nova] Creating event network-vif-deleted:81e53eeb-cca6-4142-ac38-b2e3fc3ed1a5 for instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a on hv-cinder-83482 Jul 29 07:03:52.766394 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-0342048d-0676-4c12-8ebf-f211dd3f727a req-ee421b8b-7d46-4379-8648-14b46b40a756 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043350 Jul 29 07:03:52.767175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1503/2966] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:03:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:03:53.196077 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:53.196942 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] [instance: 4b750d4e-87fd-46be-9ea0-1c48973a6d5a] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:03:53.203620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:53.204081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:53.204880 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:03:53.205331 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:03:53.219482 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] HTTP exception thrown: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a could not be found. Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Request method failure captured: Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a HTTP/1.1 Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44XNLRcfmsh1jj6KnjLvrCkO0DKxrnWYZIQ3YHOpqHgW79upwiNMYN9p54CGXUMKFH37hN-ALbZxToISucfEjjMtevkj7aV7oUq7By2SZ6AUY0qbe3cURjPzN-v0eBkNjN6vqRceltLktVJKk5AgB9qi-mBrHUYccD77hV_5jXnQLJc Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 387f03d497884045b998a6f788991e18 Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-TestMinimumBasicScenario-1019729650 Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:03:53.221165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/387f03d497884045b998a6f788991e18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/387f03d497884045b998a6f788991e18"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_387f03d497884045b998a6f788991e18", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/387f03d497884045b998a6f788991e18"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-TestMinimumBasicScenario-1019729650 Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 387f03d497884045b998a6f788991e18 Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1019729650 Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-TestMinimumBasicScenario-1019729650-project Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 13af20e11c9449fd807eeeb1b3ff898f Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-TestMinimumBasicScenario-1019729650-project Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a could not be found. Jul 29 07:03:53.222918 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '4b750d4e-87fd-46be-9ea0-1c48973a6d5a'} Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a could not be found. Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:03:53.223984 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a could not be found. Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a could not be found. Jul 29 07:03:53.225703 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:03:53.228117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Returning 404 to user: Instance 4b750d4e-87fd-46be-9ea0-1c48973a6d5a could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:03:53.228117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-c7e1a95c-5e60-4edd-9083-d7acf06e3765 tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a" status: 404 len: 111 microversion: 2.1 time: 0.030416 Jul 29 07:03:53.228117 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1464/2967] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:03:53 2022] GET /compute/v2.1/servers/4b750d4e-87fd-46be-9ea0-1c48973a6d5a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:03:53.232482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-7505d012-a250-48e7-8b4d-cdf423ee83dc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] Calling method '.version_select at 0x7f145e252550>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:03:53.250960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-7505d012-a250-48e7-8b4d-cdf423ee83dc tempest-TestMinimumBasicScenario-1019729650 tempest-TestMinimumBasicScenario-1019729650-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-475371402" status: 202 len: 0 microversion: 2.1 time: 0.023281 Jul 29 07:03:53.251520 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1504/2968] 10.222.0.33 () {58 vars in 1269 bytes} [Fri Jul 29 07:03:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-475371402 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:04:35.245240 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:04:35.245792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:04:35.248054 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:04:35.248722 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:04:35.254967 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:04:35.255420 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:04:35.256187 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:04:35.256669 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:04:35.271903 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] HTTP exception thrown: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Request method failure captured: Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 HTTP/1.1 Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432oDi6z5fuummetSbw-wZbFhgBv8wEWwGuJuzXRzY0jA6pgZXN0TKSu3ICt0iw7ciiVXX3rk8sOK-axNlCsKIAy6TI3LBXs7fM-Y-j7FzrZ3q6CbsmDV9dnresuljr5MRLmbecJ1JjCwJ9rZ49IxEcjFlVgF6PRzdFme3K6JB-Thok Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:04:35.273466 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8d1f62a52884ebb91749ef49de11bec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 217b321936224e2ba928b983c4e40017 Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.275974 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'fbb95b1b-f883-46e7-90c8-a740a4a27ca9'} Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:04:35.277206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.279110 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.280906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Returning 404 to user: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:04:35.280906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e5606d7d-c99f-4aa9-991a-69a511bade81 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 404 len: 111 microversion: 2.20 time: 0.034228 Jul 29 07:04:35.280906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1465/2969] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Jul 29 07:04:35 2022] DELETE /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 07:04:35.283834 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:04:35.284600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:04:35.288402 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:04:35.289145 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: fbb95b1b-f883-46e7-90c8-a740a4a27ca9] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:04:35.297656 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:04:35.298113 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:04:35.298888 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:04:35.299335 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:04:35.315202 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] HTTP exception thrown: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Request method failure captured: Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 HTTP/1.1 Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432oDi6z5fuummetSbw-wZbFhgBv8wEWwGuJuzXRzY0jA6pgZXN0TKSu3ICt0iw7ciiVXX3rk8sOK-axNlCsKIAy6TI3LBXs7fM-Y-j7FzrZ3q6CbsmDV9dnresuljr5MRLmbecJ1JjCwJ9rZ49IxEcjFlVgF6PRzdFme3K6JB-Thok Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:04:35.316874 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8d1f62a52884ebb91749ef49de11bec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 217b321936224e2ba928b983c4e40017 Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.318725 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': 'fbb95b1b-f883-46e7-90c8-a740a4a27ca9'} Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:04:35.319780 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. Jul 29 07:04:35.321484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:04:35.322966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Returning 404 to user: Instance fbb95b1b-f883-46e7-90c8-a740a4a27ca9 could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:04:35.322966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-ca9dab79-9302-4175-b7e7-37d6796a6255 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9" status: 404 len: 111 microversion: 2.20 time: 0.035991 Jul 29 07:04:35.322966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1505/2970] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 07:04:35 2022] GET /compute/v2.1/servers/fbb95b1b-f883-46e7-90c8-a740a4a27ca9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 07:05:01.098802 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:05:01.099384 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:05:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:05:12.661289 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:12.662032 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:12.663888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:12.664514 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:12.672008 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:12.672459 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:12.673294 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:12.673678 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:12.700081 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Going to try to terminate instance {{(pid=117957) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:05:12.777617 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-2cf5e5a7-6e0e-44a5-95ec-89142d31b9ea tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 204 len: 0 microversion: 2.1 time: 0.119899 Jul 29 07:05:12.778283 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1466/2971] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:05:12 2022] DELETE /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 07:05:12.788471 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:12.789115 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:12.791522 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:12.792157 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:12.797995 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:12.798447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:12.799209 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:12.799647 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:12.935788 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:12.944460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-972ad42b-9f72-4193-95b4-07128040a064 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1576 microversion: 2.1 time: 0.159828 Jul 29 07:05:12.945031 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1506/2972] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:12 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:13.966320 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:13.967115 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:13.973690 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:13.974148 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:13.974912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:13.975354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:14.104779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:14.112196 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ecb31af6-1ca9-48d1-ae77-1cf453ea1ee8 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1576 microversion: 2.1 time: 0.150448 Jul 29 07:05:14.112789 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1467/2973] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:13 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:15.134462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:15.135487 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:15.142022 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:15.142473 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:15.143235 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:15.143667 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:15.207766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:15.216620 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1d68456c-71e1-42f1-943c-c7f01090fef4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 200 len: 1508 microversion: 2.1 time: 0.086286 Jul 29 07:05:15.217193 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1507/2974] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:15 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 1508 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:15.348086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-dd7d5d25-4a95-4e32-8114-98ce03ad40be req-771b5db7-8895-46e0-aa3b-377d93f85279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d9a2da8-41c5-4194-a31a-81e34f574fcc", "name": "network-vif-deleted", "tag": "8c4cccca-01e9-4ed3-ad18-29af61cf4081"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:05:15.360983 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-dd7d5d25-4a95-4e32-8114-98ce03ad40be req-771b5db7-8895-46e0-aa3b-377d93f85279 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:15.361575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-dd7d5d25-4a95-4e32-8114-98ce03ad40be req-771b5db7-8895-46e0-aa3b-377d93f85279 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:15.373545 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-dd7d5d25-4a95-4e32-8114-98ce03ad40be req-771b5db7-8895-46e0-aa3b-377d93f85279 service nova] Creating event network-vif-deleted:8c4cccca-01e9-4ed3-ad18-29af61cf4081 for instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc on hv-cinder-83482 Jul 29 07:05:15.379445 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-dd7d5d25-4a95-4e32-8114-98ce03ad40be req-771b5db7-8895-46e0-aa3b-377d93f85279 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034880 Jul 29 07:05:15.379982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1468/2975] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:05:16.238553 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:16.239192 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:16.245692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:16.246136 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:16.246892 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:16.247326 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:16.260438 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] HTTP exception thrown: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Request method failure captured: Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc HTTP/1.1 Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi44X4SB4RnoFGmAZiCfcVv92xSrDHFIWgGP9U20sKLIO5dD2pJAl2hszts6VL1EQ2M2PL_eqIo3-etYe2X57Vk9CSx-SpeTvFJMgNI0arPgSnrjbPxO9YZLuLBCfejfh1AblcK1N5cmZZxjZE9NPBqkiOBiWnnKyIl0aPeP8YswbDsNM Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:05:16.262007 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17de3e5c46bb43a3973d8b9728c797b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: f0f388a7fdbc4925940a5e1a53f15f9e Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:05:16.263765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '8d9a2da8-41c5-4194-a31a-81e34f574fcc'} Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:05:16.264767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:05:16.266245 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:05:16.267642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Returning 404 to user: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:05:16.267642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-46b40a32-4ab0-4708-9da5-17214e3e493e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 404 len: 111 microversion: 2.1 time: 0.028678 Jul 29 07:05:16.267642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1508/2976] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:16 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:05:16.373017 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1821044221", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-117779030", "security_groups": [{"name": "tempest-secgroup-smoke-1337002113"}], "block_device_mapping_v2": [{"uuid": "d0a04565-cec1-4d99-b430-4b8283bde7fb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6187da0-c360-4dba-bc42-2501aeb4ec7a"}]}} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:05:16.484652 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.network.neutron [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] validate_networks() for [('b6187da0-c360-4dba-bc42-2501aeb4ec7a', None, None, None, None, None)] {{(pid=117957) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 07:05:16.865006 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Flavor limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 07:05:16.865437 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Image limits 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 07:05:16.865912 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Flavor pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 07:05:16.866351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Image pref 0:0:0 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 07:05:16.866763 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.virt.hardware [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117957) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 07:05:16.875888 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:16.876332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:16.877152 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:16.877587 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:16.900922 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:05:16.905018 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.quota [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for user f0f388a7fdbc4925940a5e1a53f15f9e and project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117957) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:05:16.963228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Going to run 1 instances... {{(pid=117957) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 07:05:16.965439 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d0a04565-cec1-4d99-b430-4b8283bde7fb',volume_size=None,volume_type=None)] {{(pid=117957) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 07:05:17.096060 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-97e61a18-360e-49b8-91fc-cce736c369f6 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.727000 Jul 29 07:05:17.096730 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1469/2977] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 07:05:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 07:05:17.107468 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-98d48bc7-1281-4e30-9758-d4de4ac70f85 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:17.108087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-98d48bc7-1281-4e30-9758-d4de4ac70f85 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:17.161703 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-98d48bc7-1281-4e30-9758-d4de4ac70f85 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:17.168628 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-98d48bc7-1281-4e30-9758-d4de4ac70f85 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1094 microversion: 2.1 time: 0.065064 Jul 29 07:05:17.169365 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1509/2978] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:17 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:18.190325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:18.190934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:18.198382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:18.198836 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:18.199606 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:18.200049 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:18.269362 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:18.277768 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-1597ca3b-2a12-4a71-8e13-2ab92fc21397 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1210 microversion: 2.1 time: 0.091435 Jul 29 07:05:18.278374 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1470/2979] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:18 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:19.298936 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:19.300194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:19.308295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:19.308895 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:19.309705 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:19.310160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:19.374890 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-63f9447e-ddab-4820-abc2-cf39f2844dbf req-91cf8330-ce90-4b91-8550-9175bcb7a575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db49ba-4dd8-455c-90c9-5f1c7b4ca933", "tag": "bf9be5b1-d953-4cc1-8115-1ea7ff3171a1"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:05:19.410084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-63f9447e-ddab-4820-abc2-cf39f2844dbf req-91cf8330-ce90-4b91-8550-9175bcb7a575 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:19.410764 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-63f9447e-ddab-4820-abc2-cf39f2844dbf req-91cf8330-ce90-4b91-8550-9175bcb7a575 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:19.433794 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-63f9447e-ddab-4820-abc2-cf39f2844dbf req-91cf8330-ce90-4b91-8550-9175bcb7a575 service nova] Creating event network-changed:bf9be5b1-d953-4cc1-8115-1ea7ff3171a1 for instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 on hv-cinder-83482 Jul 29 07:05:19.444376 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-63f9447e-ddab-4820-abc2-cf39f2844dbf req-91cf8330-ce90-4b91-8550-9175bcb7a575 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073743 Jul 29 07:05:19.451497 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1471/2980] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:05:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:05:19.476017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:19.494672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1e1181f5-1c7b-45cd-87f3-180dc74925bc tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.199481 Jul 29 07:05:19.496018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1510/2981] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:19 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:20.517877 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:20.518577 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:20.525488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:20.525940 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:20.526717 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:20.527184 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:20.658620 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:20.666327 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-79add968-16f1-4a68-ac9f-fcbf48054049 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.153059 Jul 29 07:05:20.666881 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1472/2982] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:20 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:21.687820 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:21.688397 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:21.694823 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:21.695266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:21.696020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:21.696563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:21.824828 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:21.832129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b93f1803-d150-4529-95d1-9ee3e7286c01 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.148225 Jul 29 07:05:21.832755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1511/2983] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:21 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:22.854307 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:22.854921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:22.861785 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:22.862241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:22.863037 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:22.863477 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:22.998567 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:23.006379 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d67b54dd-d244-4bc6-b113-4ab41551bbbe tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.156429 Jul 29 07:05:23.006946 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1473/2984] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:22 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:24.027939 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:24.028495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:24.034945 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:24.035387 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:24.036133 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:24.036584 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:24.165283 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:24.172751 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5953835e-0f0c-40a6-9e27-47a9dc4e38f0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.149407 Jul 29 07:05:24.173303 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1512/2985] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:24 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:25.192550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:25.193179 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:25.200078 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:25.200528 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:25.201309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:25.201746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:25.328971 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:25.336206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-59efd6f7-f830-4db8-a3b0-ba2042075746 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.147422 Jul 29 07:05:25.337304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1474/2986] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:25 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:26.358605 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:26.359216 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:26.365267 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:26.365732 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:26.366472 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:26.366905 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:26.500164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:26.507600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-5bfbdb80-bf9c-400b-a0d0-5779e2da9663 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.153198 Jul 29 07:05:26.508162 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1513/2987] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:26 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:27.529758 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:27.530332 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:27.532697 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:27.533481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=6 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:27.540347 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:27.540831 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:27.541582 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:27.542016 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:27.671524 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:27.678793 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-78126791-69fb-4f83-af6b-c06e6c72b998 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.152930 Jul 29 07:05:27.679345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1475/2988] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:27 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:28.699612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:28.700228 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:28.702125 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:05:28.708072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:28.708565 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:28.709323 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:28.709767 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:28.842232 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:28.849675 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-59e07d36-c853-461b-ae8f-31f81e3fb959 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.153984 Jul 29 07:05:28.850239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1514/2989] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:28 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:29.872125 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:29.872807 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:29.878715 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:29.879164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:29.879920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:29.880354 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:29.961417 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-71d931c0-712c-47e0-bb08-2b331d90f178 req-d459ba1f-382c-46b8-9654-7055e6c72ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db49ba-4dd8-455c-90c9-5f1c7b4ca933", "name": "network-vif-plugged", "status": "completed", "tag": "bf9be5b1-d953-4cc1-8115-1ea7ff3171a1"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:05:29.972765 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-71d931c0-712c-47e0-bb08-2b331d90f178 req-d459ba1f-382c-46b8-9654-7055e6c72ef5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:29.973451 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-71d931c0-712c-47e0-bb08-2b331d90f178 req-d459ba1f-382c-46b8-9654-7055e6c72ef5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:29.986480 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-71d931c0-712c-47e0-bb08-2b331d90f178 req-d459ba1f-382c-46b8-9654-7055e6c72ef5 service nova] Creating event network-vif-plugged:bf9be5b1-d953-4cc1-8115-1ea7ff3171a1 for instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 on hv-cinder-83482 Jul 29 07:05:29.991424 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-71d931c0-712c-47e0-bb08-2b331d90f178 req-d459ba1f-382c-46b8-9654-7055e6c72ef5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034322 Jul 29 07:05:29.992444 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1515/2990] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 07:05:30.017164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:30.025615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-e9fce241-a19a-44ab-9b7d-e857c83dbf49 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.158468 Jul 29 07:05:30.026198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1476/2991] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:29 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:31.047393 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:31.048116 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:31.054843 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:31.055334 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:31.056416 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:31.056875 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:31.193491 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:31.201790 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a230a472-1752-441b-85d4-ebafc292f42c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1266 microversion: 2.1 time: 0.159028 Jul 29 07:05:31.202358 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1516/2992] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:31 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:32.222843 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:32.223465 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:32.230005 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:32.231299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:32.231749 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:32.232191 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:32.366218 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:32.374686 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-416fc40e-3f7e-4488-adf7-d084e9792319 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1453 microversion: 2.1 time: 0.155660 Jul 29 07:05:32.375246 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1477/2993] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:32 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:32.394814 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:05:32.395429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:05:32.401871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:32.402813 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:32.403582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:32.404017 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:32.534482 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:05:32.542059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-079829cf-b861-433e-9888-94441f3c9c71 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1453 microversion: 2.1 time: 0.151007 Jul 29 07:05:32.543460 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1517/2994] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:05:32 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:05:34.360639 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-87432c2c-9308-4dfb-ac89-3a4e32b62260 req-b52000a1-4515-4d7c-8c1f-c478122343a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db49ba-4dd8-455c-90c9-5f1c7b4ca933", "tag": "bf9be5b1-d953-4cc1-8115-1ea7ff3171a1"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:05:34.371549 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-87432c2c-9308-4dfb-ac89-3a4e32b62260 req-b52000a1-4515-4d7c-8c1f-c478122343a5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:05:34.372034 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-87432c2c-9308-4dfb-ac89-3a4e32b62260 req-b52000a1-4515-4d7c-8c1f-c478122343a5 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:05:34.383126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-87432c2c-9308-4dfb-ac89-3a4e32b62260 req-b52000a1-4515-4d7c-8c1f-c478122343a5 service nova] Creating event network-changed:bf9be5b1-d953-4cc1-8115-1ea7ff3171a1 for instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 on hv-cinder-83482 Jul 29 07:05:34.388792 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-87432c2c-9308-4dfb-ac89-3a4e32b62260 req-b52000a1-4515-4d7c-8c1f-c478122343a5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031849 Jul 29 07:05:34.389541 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1478/2995] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:07:11.450534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:07:11.451153 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:07:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:07:20.019072 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=26 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:20.019819 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=58 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:20.023748 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1513357422", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-117779030", "security_groups": [{"name": "tempest-secgroup-smoke-1337002113"}], "block_device_mapping_v2": [{"uuid": "02b39274-0c10-4106-bb75-074da8158949", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b6187da0-c360-4dba-bc42-2501aeb4ec7a"}]}} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:07:20.135109 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.network.neutron [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] validate_networks() for [('b6187da0-c360-4dba-bc42-2501aeb4ec7a', None, None, None, None, None)] {{(pid=117958) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 07:07:20.602223 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Flavor limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 07:07:20.602653 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Image limits 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 07:07:20.603131 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Flavor pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 07:07:20.603547 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Image pref 0:0:0 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 07:07:20.603994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.virt.hardware [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117958) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 07:07:20.613229 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:20.613682 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:20.614481 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:20.614923 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:20.632201 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 07:07:20.636148 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.quota [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Getting quotas for user f0f388a7fdbc4925940a5e1a53f15f9e and project 17de3e5c46bb43a3973d8b9728c797b7. Resources: {'cores', 'instances', 'ram'} {{(pid=117958) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 07:07:20.700871 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Going to run 1 instances... {{(pid=117958) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 07:07:20.702919 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='02b39274-0c10-4106-bb75-074da8158949',volume_size=None,volume_type=None)] {{(pid=117958) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 07:07:20.831206 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3fd28329-dd1b-4ab9-9c91-afce3d27391d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814451 Jul 29 07:07:20.831841 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1518/2996] 10.222.0.33 () {60 vars in 1147 bytes} [Fri Jul 29 07:07:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 07:07:20.841557 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:20.842304 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:20.846679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-cf1c6681-941b-40c3-a422-78d13681b399 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:20.847388 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-cf1c6681-941b-40c3-a422-78d13681b399 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:20.908909 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-cf1c6681-941b-40c3-a422-78d13681b399 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:20.915709 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-cf1c6681-941b-40c3-a422-78d13681b399 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1094 microversion: 2.1 time: 0.076474 Jul 29 07:07:20.916382 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1479/2997] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:20 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:21.936059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:21.936860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:21.945344 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:21.945801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:21.946613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:21.947057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:22.015594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:22.023661 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c22cc56e-836f-4bf1-b0d9-54a61085fa31 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1210 microversion: 2.1 time: 0.091244 Jul 29 07:07:22.024224 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1519/2998] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:21 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1210 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:23.045301 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:23.047711 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:23.059228 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:23.059809 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:23.060710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:23.061227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:23.233563 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [req-6e42f70f-31fa-4c55-b191-b4e1a84241ba req-299b3ccc-1c32-4247-bcd6-154230a24780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06980c3-9821-4471-916f-0d03ef800195", "tag": "2377037b-e643-458d-b0bd-e867659cf4f6"}]} {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:07:23.247546 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-6e42f70f-31fa-4c55-b191-b4e1a84241ba req-299b3ccc-1c32-4247-bcd6-154230a24780 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:23.248296 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [req-6e42f70f-31fa-4c55-b191-b4e1a84241ba req-299b3ccc-1c32-4247-bcd6-154230a24780 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:23.264942 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.compute.server_external_events [req-6e42f70f-31fa-4c55-b191-b4e1a84241ba req-299b3ccc-1c32-4247-bcd6-154230a24780 service nova] Creating event network-changed:2377037b-e643-458d-b0bd-e867659cf4f6 for instance f06980c3-9821-4471-916f-0d03ef800195 on hv-cinder-83482 Jul 29 07:07:23.271801 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [req-6e42f70f-31fa-4c55-b191-b4e1a84241ba req-299b3ccc-1c32-4247-bcd6-154230a24780 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042013 Jul 29 07:07:23.272713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1520/2999] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:07:23.322351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:23.331916 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-367fc8c0-f35a-4901-8a41-0f498367457d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.290564 Jul 29 07:07:23.333002 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1480/3000] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:23 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:24.355295 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:24.356111 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:24.363088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:24.363539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:24.364302 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:24.364768 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:24.495809 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:24.503772 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d258c219-1424-482c-9b45-361fe5e6886b tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.153041 Jul 29 07:07:24.504336 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1521/3001] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:24 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:25.524530 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:25.525165 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:25.531268 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:25.531719 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:25.532469 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:25.532979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:25.665693 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:25.673096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8a1631ff-80b5-45e1-8927-6d65ee983c2f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.152454 Jul 29 07:07:25.684623 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1481/3002] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:25 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:26.696160 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:26.696792 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:26.703166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:26.703613 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:26.704395 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:26.705057 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:26.836305 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:26.843902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-622000cb-b08b-421e-867d-bc856250c37d tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.151660 Jul 29 07:07:26.844454 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1522/3003] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:26 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:27.864901 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:27.865513 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:27.871894 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:27.872346 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:27.873141 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:27.873580 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:28.002417 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:28.009889 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-feb6e009-dd26-49a0-b662-659d35c1d042 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.148784 Jul 29 07:07:28.010451 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1482/3004] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:27 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:29.030812 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:29.031419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:29.038495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:29.038971 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:29.039726 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:29.040170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:29.168205 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:29.176254 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-8e9a9329-3569-490e-b097-75797adb9ceb tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.149326 Jul 29 07:07:29.177052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1523/3005] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:29 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:30.196937 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:30.197542 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:30.204160 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:30.204753 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:30.205503 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:30.205934 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:30.454481 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:30.462001 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-3131e162-467e-4fdb-8467-3ba35cca9137 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.269039 Jul 29 07:07:30.462839 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1483/3006] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:30 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:31.483300 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:31.483908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:31.487103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:31.487832 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell0:SELECT=6 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:31.493830 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:31.494271 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:31.495020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:31.495447 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:31.674045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:31.681960 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b290ecbb-006e-4931-838d-9d9432d7be30 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.202415 Jul 29 07:07:31.682528 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1524/3007] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:31 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:32.700305 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell0:SELECT=2 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:07:32.707924 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:32.708649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:32.715920 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:32.717244 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:32.718031 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:32.718476 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:32.850136 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:32.857416 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-bdab15ea-7ba5-4b71-ab8f-27d599d7feb3 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.157925 Jul 29 07:07:32.857977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1484/3008] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:32 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:33.878566 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:33.879185 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:33.885722 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:33.886175 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:33.886938 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:33.887378 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:34.020217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:34.027539 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-c17eda55-e995-4485-add9-4b887fa9fa3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.152811 Jul 29 07:07:34.028091 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1525/3009] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:33 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:34.480585 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-a11acdae-e81e-49ca-a415-84b879aba223 req-1f069ea1-4192-42e3-9b6a-855b4269ab8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06980c3-9821-4471-916f-0d03ef800195", "name": "network-vif-plugged", "status": "completed", "tag": "2377037b-e643-458d-b0bd-e867659cf4f6"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:07:34.491098 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-a11acdae-e81e-49ca-a415-84b879aba223 req-1f069ea1-4192-42e3-9b6a-855b4269ab8a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:34.491547 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-a11acdae-e81e-49ca-a415-84b879aba223 req-1f069ea1-4192-42e3-9b6a-855b4269ab8a service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:34.502746 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-a11acdae-e81e-49ca-a415-84b879aba223 req-1f069ea1-4192-42e3-9b6a-855b4269ab8a service nova] Creating event network-vif-plugged:2377037b-e643-458d-b0bd-e867659cf4f6 for instance f06980c3-9821-4471-916f-0d03ef800195 on hv-cinder-83482 Jul 29 07:07:34.507777 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-a11acdae-e81e-49ca-a415-84b879aba223 req-1f069ea1-4192-42e3-9b6a-855b4269ab8a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092614 Jul 29 07:07:34.508345 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1485/3010] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:07:35.048889 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:35.049486 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:35.055755 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:35.056198 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:35.056981 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:35.057409 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:35.186332 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:35.194429 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d1896bbb-ad89-4fdc-b583-0bbd207aa7d4 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1266 microversion: 2.1 time: 0.149593 Jul 29 07:07:35.194994 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1526/3011] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:35 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:36.217241 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:36.217977 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:36.224973 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:36.225432 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:36.226198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:36.226640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:36.360137 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:36.367790 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-32ad3a66-bd9e-4c30-9f3f-5ac79b71e278 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1453 microversion: 2.1 time: 0.155547 Jul 29 07:07:36.368351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1486/3012] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:36 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:36.387548 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:07:36.388158 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:07:36.395306 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:36.395766 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:36.396612 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:36.397058 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:36.531860 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:07:36.539483 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-d28208ba-9a28-4058-bff3-3574757c392f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1453 microversion: 2.1 time: 0.155720 Jul 29 07:07:36.540045 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1527/3013] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:07:36 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1453 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:07:38.398225 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-e56874c8-77ce-488c-8f62-6d79f89ccded req-92cbfdcb-c61f-47db-9e6d-5458a98589db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06980c3-9821-4471-916f-0d03ef800195", "tag": "2377037b-e643-458d-b0bd-e867659cf4f6"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:07:38.408571 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-e56874c8-77ce-488c-8f62-6d79f89ccded req-92cbfdcb-c61f-47db-9e6d-5458a98589db service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:07:38.409181 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-e56874c8-77ce-488c-8f62-6d79f89ccded req-92cbfdcb-c61f-47db-9e6d-5458a98589db service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:07:38.421484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-e56874c8-77ce-488c-8f62-6d79f89ccded req-92cbfdcb-c61f-47db-9e6d-5458a98589db service nova] Creating event network-changed:2377037b-e643-458d-b0bd-e867659cf4f6 for instance f06980c3-9821-4471-916f-0d03ef800195 on hv-cinder-83482 Jul 29 07:07:38.427573 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-e56874c8-77ce-488c-8f62-6d79f89ccded req-92cbfdcb-c61f-47db-9e6d-5458a98589db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092648 Jul 29 07:07:38.428170 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1487/3014] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:08:21.107488 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:08:21.108206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:08:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:09:10.213911 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=20 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:09:10.214534 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:10.214893 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:10.214975 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=40 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:09:10.219924 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:09:10.220688 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=52 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:09:10.220926 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-17b04642-5d91-4bf3-aad1-a508dc3824b5 req-f57fc3b6-f271-446c-9a4c-8c0e035cdf99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f06980c3-9821-4471-916f-0d03ef800195", "tag": "2377037b-e643-458d-b0bd-e867659cf4f6"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:09:10.222621 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:10.223102 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:10.223877 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:10.224311 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:10.231540 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-17b04642-5d91-4bf3-aad1-a508dc3824b5 req-f57fc3b6-f271-446c-9a4c-8c0e035cdf99 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:10.231982 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-17b04642-5d91-4bf3-aad1-a508dc3824b5 req-f57fc3b6-f271-446c-9a4c-8c0e035cdf99 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:10.243658 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-17b04642-5d91-4bf3-aad1-a508dc3824b5 req-f57fc3b6-f271-446c-9a4c-8c0e035cdf99 service nova] Creating event network-changed:2377037b-e643-458d-b0bd-e867659cf4f6 for instance f06980c3-9821-4471-916f-0d03ef800195 on hv-cinder-83482 Jul 29 07:09:10.249164 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-17b04642-5d91-4bf3-aad1-a508dc3824b5 req-f57fc3b6-f271-446c-9a4c-8c0e035cdf99 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037324 Jul 29 07:09:10.250895 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1488/3015] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:09:10.252815 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:09:10.347699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-53dd7682-2d58-411a-9fbf-935566d90996 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 204 len: 0 microversion: 2.1 time: 0.138070 Jul 29 07:09:10.348382 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1528/3016] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:09:10 2022] DELETE /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 07:09:10.357550 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:10.358383 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:10.368070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:10.368501 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:10.369227 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:10.369662 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:10.510155 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:09:10.518487 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-a861b39e-42c9-4f10-bf7c-f88f857bca67 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1577 microversion: 2.1 time: 0.165052 Jul 29 07:09:10.519059 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1489/3017] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:10 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:09:11.545399 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:11.546103 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:11.553951 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:11.554398 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:11.555164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:11.555596 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:11.689233 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:09:11.696718 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b097add3-fac5-491b-9ced-d6ab4cbd95b2 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1577 microversion: 2.1 time: 0.161209 Jul 29 07:09:11.697279 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1529/3018] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:11 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 07:09:12.292866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-5b9d7de4-6491-437a-96af-f5ce96e77ab4 req-30bf22c0-593e-432d-9f89-8d5a2f916c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f06980c3-9821-4471-916f-0d03ef800195", "name": "network-vif-deleted", "tag": "2377037b-e643-458d-b0bd-e867659cf4f6"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:09:12.305463 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-5b9d7de4-6491-437a-96af-f5ce96e77ab4 req-30bf22c0-593e-432d-9f89-8d5a2f916c44 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:12.305906 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-5b9d7de4-6491-437a-96af-f5ce96e77ab4 req-30bf22c0-593e-432d-9f89-8d5a2f916c44 service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:12.320086 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-5b9d7de4-6491-437a-96af-f5ce96e77ab4 req-30bf22c0-593e-432d-9f89-8d5a2f916c44 service nova] Creating event network-vif-deleted:2377037b-e643-458d-b0bd-e867659cf4f6 for instance f06980c3-9821-4471-916f-0d03ef800195 on hv-cinder-83482 Jul 29 07:09:12.324841 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-5b9d7de4-6491-437a-96af-f5ce96e77ab4 req-30bf22c0-593e-432d-9f89-8d5a2f916c44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035681 Jul 29 07:09:12.325596 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1490/3019] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:09:12.721164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:12.721164 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:12.726240 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:12.726692 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:12.727466 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:12.727902 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:12.759194 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:12.759640 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:12.760089 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lazy-loading 'fault' on Instance uuid f06980c3-9821-4471-916f-0d03ef800195 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:09:12.800634 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:09:12.807913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-b692667c-23fa-40b9-b15f-a32c6dc9bb68 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 200 len: 1230 microversion: 2.1 time: 0.093781 Jul 29 07:09:12.808467 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1530/3020] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:12 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 1230 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:09:13.830947 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:13.831640 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: f06980c3-9821-4471-916f-0d03ef800195] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:13.838026 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:13.838479 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:13.839239 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:13.839649 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:13.853023 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] HTTP exception thrown: Instance f06980c3-9821-4471-916f-0d03ef800195 could not be found. Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Request method failure captured: Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 HTTP/1.1 Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44X4SB4RnoFGmAZiCfcVv92xSrDHFIWgGP9U20sKLIO5dD2pJAl2hszts6VL1EQ2M2PL_eqIo3-etYe2X57Vk9CSx-SpeTvFJMgNI0arPgSnrjbPxO9YZLuLBCfejfh1AblcK1N5cmZZxjZE9NPBqkiOBiWnnKyIl0aPeP8YswbDsNM Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:09:13.854611 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17de3e5c46bb43a3973d8b9728c797b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: f0f388a7fdbc4925940a5e1a53f15f9e Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance f06980c3-9821-4471-916f-0d03ef800195 could not be found. Jul 29 07:09:13.855810 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': 'f06980c3-9821-4471-916f-0d03ef800195'} Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f06980c3-9821-4471-916f-0d03ef800195 could not be found. Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:09:13.856496 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f06980c3-9821-4471-916f-0d03ef800195 could not be found. Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f06980c3-9821-4471-916f-0d03ef800195 could not be found. Jul 29 07:09:13.857710 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:13.858735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Returning 404 to user: Instance f06980c3-9821-4471-916f-0d03ef800195 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:09:13.858735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-8b70addb-ec70-480d-9fbf-cfa49cdd0f0c tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195" status: 404 len: 111 microversion: 2.1 time: 0.030179 Jul 29 07:09:13.858735 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1491/3021] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:13 2022] GET /compute/v2.1/servers/f06980c3-9821-4471-916f-0d03ef800195 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:09:16.892342 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:16.893018 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:16.894206 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-c167f481-7896-401c-9ec5-598325a24096 req-148cc890-942f-4a40-bdbd-1bf4a202949d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04db49ba-4dd8-455c-90c9-5f1c7b4ca933", "tag": "bf9be5b1-d953-4cc1-8115-1ea7ff3171a1"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:09:16.899582 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:16.900239 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:16.901218 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:16.901827 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:16.911309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-c167f481-7896-401c-9ec5-598325a24096 req-148cc890-942f-4a40-bdbd-1bf4a202949d service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:16.911309 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-c167f481-7896-401c-9ec5-598325a24096 req-148cc890-942f-4a40-bdbd-1bf4a202949d service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:16.925177 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-c167f481-7896-401c-9ec5-598325a24096 req-148cc890-942f-4a40-bdbd-1bf4a202949d service nova] Creating event network-changed:bf9be5b1-d953-4cc1-8115-1ea7ff3171a1 for instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 on hv-cinder-83482 Jul 29 07:09:16.930637 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-c167f481-7896-401c-9ec5-598325a24096 req-148cc890-942f-4a40-bdbd-1bf4a202949d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040327 Jul 29 07:09:16.931421 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1492/3022] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:09:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 07:09:16.941266 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Going to try to terminate instance {{(pid=117958) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 07:09:17.039493 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-f53ba78c-6fed-4334-95ae-0684ae0ec5bf tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "DELETE /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 204 len: 0 microversion: 2.1 time: 0.151305 Jul 29 07:09:17.040405 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1531/3023] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:09:16 2022] DELETE /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 07:09:17.049089 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:17.050126 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:17.056716 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:17.057351 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:17.059084 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:17.059808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:17.198726 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.policy [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117957) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:09:17.206299 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d58a64b0-7ea3-478c-952e-16a56ab73c53 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1577 microversion: 2.1 time: 0.161693 Jul 29 07:09:17.206886 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1493/3024] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:17 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:09:18.227742 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:18.228462 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:18.235170 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:18.235844 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:18.236633 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:18.237066 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:18.442540 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:09:18.450907 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fcc0702d-29e4-40b8-afc8-d50fcab0afb9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1577 microversion: 2.1 time: 0.227350 Jul 29 07:09:18.451672 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1532/3025] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:18 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:09:18.992291 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [req-61db4331-0fb5-471d-be4a-ee96001f2481 req-97004617-537d-4ff5-ac6a-e0a1aa3b993d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04db49ba-4dd8-455c-90c9-5f1c7b4ca933", "name": "network-vif-deleted", "tag": "bf9be5b1-d953-4cc1-8115-1ea7ff3171a1"}]} {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 07:09:19.003103 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-61db4331-0fb5-471d-be4a-ee96001f2481 req-97004617-537d-4ff5-ac6a-e0a1aa3b993d service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:19.003741 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [req-61db4331-0fb5-471d-be4a-ee96001f2481 req-97004617-537d-4ff5-ac6a-e0a1aa3b993d service nova] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:19.014229 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.compute.server_external_events [req-61db4331-0fb5-471d-be4a-ee96001f2481 req-97004617-537d-4ff5-ac6a-e0a1aa3b993d service nova] Creating event network-vif-deleted:bf9be5b1-d953-4cc1-8115-1ea7ff3171a1 for instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 on hv-cinder-83482 Jul 29 07:09:19.018979 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [req-61db4331-0fb5-471d-be4a-ee96001f2481 req-97004617-537d-4ff5-ac6a-e0a1aa3b993d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108425 Jul 29 07:09:19.019615 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1494/3026] 10.222.0.33 () {64 vars in 1317 bytes} [Fri Jul 29 07:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:09:19.472419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:19.473168 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:19.479783 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:19.480359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:19.481088 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:19.481525 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:19.519033 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:19.519340 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:19.528706 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.objects.instance [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lazy-loading 'fault' on Instance uuid 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 {{(pid=117958) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 07:09:19.578211 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.policy [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f388a7fdbc4925940a5e1a53f15f9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17de3e5c46bb43a3973d8b9728c797b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117958) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 07:09:19.585740 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-3a4067d7-99ff-4cb0-8210-eba835674c3f tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 200 len: 1184 microversion: 2.1 time: 0.117390 Jul 29 07:09:19.586301 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1533/3027] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:19 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 1184 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:09:20.608315 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:20.609053 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 04db49ba-4dd8-455c-90c9-5f1c7b4ca933] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:20.615929 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:20.616405 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:20.617198 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:20.617657 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:20.631380 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] HTTP exception thrown: Instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 could not be found. Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Request method failure captured: Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 HTTP/1.1 Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44X4SB4RnoFGmAZiCfcVv92xSrDHFIWgGP9U20sKLIO5dD2pJAl2hszts6VL1EQ2M2PL_eqIo3-etYe2X57Vk9CSx-SpeTvFJMgNI0arPgSnrjbPxO9YZLuLBCfejfh1AblcK1N5cmZZxjZE9NPBqkiOBiWnnKyIl0aPeP8YswbDsNM Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:09:20.633011 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17de3e5c46bb43a3973d8b9728c797b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: f0f388a7fdbc4925940a5e1a53f15f9e Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 could not be found. Jul 29 07:09:20.634174 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '04db49ba-4dd8-455c-90c9-5f1c7b4ca933'} Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 could not be found. Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:09:20.634791 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 could not be found. Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 could not be found. Jul 29 07:09:20.637169 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:20.638172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Returning 404 to user: Instance 04db49ba-4dd8-455c-90c9-5f1c7b4ca933 could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:09:20.638172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-d0249d2a-397d-48ca-9192-75d6ea17b0b9 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933" status: 404 len: 111 microversion: 2.1 time: 0.030868 Jul 29 07:09:20.638172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1495/3028] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:20 2022] GET /compute/v2.1/servers/04db49ba-4dd8-455c-90c9-5f1c7b4ca933 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:09:21.292421 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:21.292930 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:21.299918 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:21.300363 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:21.301138 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:21.301571 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:21.315285 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] HTTP exception thrown: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Request method failure captured: Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: DELETE /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc HTTP/1.1 Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi44X4SB4RnoFGmAZiCfcVv92xSrDHFIWgGP9U20sKLIO5dD2pJAl2hszts6VL1EQ2M2PL_eqIo3-etYe2X57Vk9CSx-SpeTvFJMgNI0arPgSnrjbPxO9YZLuLBCfejfh1AblcK1N5cmZZxjZE9NPBqkiOBiWnnKyIl0aPeP8YswbDsNM Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:09:21.316961 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17de3e5c46bb43a3973d8b9728c797b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: f0f388a7fdbc4925940a5e1a53f15f9e Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.317989 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '8d9a2da8-41c5-4194-a31a-81e34f574fcc'} Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:09:21.318606 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.319829 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.320944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Returning 404 to user: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:09:21.320944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a49ff056-c1a1-427e-ba8b-543b7b507dd0 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 404 len: 111 microversion: 2.1 time: 0.029742 Jul 29 07:09:21.320944 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1534/3029] 10.222.0.33 () {58 vars in 1239 bytes} [Fri Jul 29 07:09:21 2022] DELETE /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:09:21.327061 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:21.327676 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] [instance: 8d9a2da8-41c5-4194-a31a-81e34f574fcc] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:09:21.334051 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:21.334506 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:21.335278 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:09:21.335718 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:09:21.349267 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] HTTP exception thrown: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Request method failure captured: Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc HTTP/1.1 Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi44X4SB4RnoFGmAZiCfcVv92xSrDHFIWgGP9U20sKLIO5dD2pJAl2hszts6VL1EQ2M2PL_eqIo3-etYe2X57Vk9CSx-SpeTvFJMgNI0arPgSnrjbPxO9YZLuLBCfejfh1AblcK1N5cmZZxjZE9NPBqkiOBiWnnKyIl0aPeP8YswbDsNM Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:09:21.350808 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_17de3e5c46bb43a3973d8b9728c797b7", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/17de3e5c46bb43a3973d8b9728c797b7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: 17de3e5c46bb43a3973d8b9728c797b7 Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-TestVolumeBootPattern-1504830599 Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: f0f388a7fdbc4925940a5e1a53f15f9e Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-TestVolumeBootPattern-1504830599-project Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.352070 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '8d9a2da8-41c5-4194-a31a-81e34f574fcc'} Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:09:21.352803 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. Jul 29 07:09:21.354088 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:09:21.355325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Returning 404 to user: Instance 8d9a2da8-41c5-4194-a31a-81e34f574fcc could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:09:21.355325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9bf865e5-3b05-46e5-bb7e-89f38bcd1843 tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc" status: 404 len: 111 microversion: 2.1 time: 0.029033 Jul 29 07:09:21.355325 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1496/3030] 10.222.0.33 () {58 vars in 1236 bytes} [Fri Jul 29 07:09:21 2022] GET /compute/v2.1/servers/8d9a2da8-41c5-4194-a31a-81e34f574fcc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 07:09:22.640632 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-fe5d42db-5f6b-4341-869a-4075cb0cb90e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] Calling method '.version_select at 0x7f145a3bfaf0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:09:22.664713 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-fe5d42db-5f6b-4341-869a-4075cb0cb90e tempest-TestVolumeBootPattern-1504830599 tempest-TestVolumeBootPattern-1504830599-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-117779030" status: 202 len: 0 microversion: 2.1 time: 0.028448 Jul 29 07:09:22.665290 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1535/3031] 10.222.0.33 () {58 vars in 1260 bytes} [Fri Jul 29 07:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-117779030 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 07:09:54.498806 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:09:54.499484 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:09:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:10:19.646656 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:10:19.647208 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:10:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:10:35.145097 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_api:SELECT=18 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:10:35.145830 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG dbcounter [-] [117957] Writing DB stats nova_cell1:SELECT=26 {{(pid=117957) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:10:35.149679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:35.150172 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.compute.api [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117957) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:10:35.157970 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:10:35.158426 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:10:35.159189 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:10:35.159627 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG oslo_concurrency.lockutils [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117957) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:10:35.173633 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.wsgi [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] HTTP exception thrown: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Request method failure captured: Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: request: DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f HTTP/1.1 Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept: application/json Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Accept-Encoding: identity Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Connection: close Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Length: 0 Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Content-Type: application/json Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Host: 10.222.0.33 Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Openstack-System-Scope: None Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: User-Agent: python-urllib3/1.26.10 Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Auth-Token: gAAAAABi432oDi6z5fuummetSbw-wZbFhgBv8wEWwGuJuzXRzY0jA6pgZXN0TKSu3ICt0iw7ciiVXX3rk8sOK-axNlCsKIAy6TI3LBXs7fM-Y-j7FzrZ3q6CbsmDV9dnresuljr5MRLmbecJ1JjCwJ9rZ49IxEcjFlVgF6PRzdFme3K6JB-Thok Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Id: None Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Domain-Name: None Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Identity-Status: Confirmed Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Is-Admin-Project: True Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Id: default Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Domain-Name: Default Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Role: reader,member Jul 29 07:10:35.175195 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Roles: reader,member Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8d1f62a52884ebb91749ef49de11bec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Id: default Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Domain-Name: Default Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Id: 217b321936224e2ba928b983c4e40017 Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: X-User-Name: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: method: > Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: exception: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.176575 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: action_args: {'id': '6e189d03-298a-49f1-8edc-ee412247810f'} Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:10:35.177371 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.178679 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.180112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Returning 404 to user: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. {{(pid=117957) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:10:35.180112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-efca2fba-5410-436e-9cbe-af2787874780 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 404 len: 111 microversion: 2.20 time: 0.033213 Jul 29 07:10:35.180112 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1497/3032] 10.222.0.33 () {60 vars in 1280 bytes} [Fri Jul 29 07:10:35 2022] DELETE /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 07:10:35.183059 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:10:35.183789 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG dbcounter [-] [117958] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117958) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 07:10:35.188166 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Calling method '>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:35.189642 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.compute.api [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] [instance: 6e189d03-298a-49f1-8edc-ee412247810f] Fetching instance by UUID {{(pid=117958) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 07:10:35.197400 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:10:35.197847 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:10:35.198600 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 07:10:35.199032 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG oslo_concurrency.lockutils [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Lock "5679f4af-1630-4c5a-bcc4-7bc921697664" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117958) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 07:10:35.214419 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.wsgi [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] HTTP exception thrown: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Request method failure captured: Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: request: GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f HTTP/1.1 Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept: application/json Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Accept-Encoding: identity Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Connection: close Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Length: 0 Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Content-Type: application/json Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Host: 10.222.0.33 Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Openstack-System-Scope: None Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: User-Agent: python-urllib3/1.26.10 Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Auth-Token: gAAAAABi432oDi6z5fuummetSbw-wZbFhgBv8wEWwGuJuzXRzY0jA6pgZXN0TKSu3ICt0iw7ciiVXX3rk8sOK-axNlCsKIAy6TI3LBXs7fM-Y-j7FzrZ3q6CbsmDV9dnresuljr5MRLmbecJ1JjCwJ9rZ49IxEcjFlVgF6PRzdFme3K6JB-Thok Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Id: None Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Domain-Name: None Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Identity-Status: Confirmed Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Is-Admin-Project: True Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Id: default Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Domain-Name: Default Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Role: reader,member Jul 29 07:10:35.215952 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Roles: reader,member Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f8d1f62a52884ebb91749ef49de11bec", "adminURL": "http://10.222.0.33:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f8d1f62a52884ebb91749ef49de11bec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}] Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Id: f8d1f62a52884ebb91749ef49de11bec Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-712951082 Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Id: default Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Domain-Name: Default Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Id: 217b321936224e2ba928b983c4e40017 Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: X-User-Name: tempest-AttachVolumeShelveTestJSON-712951082-project Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: method: > Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: exception: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.217908 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: action_args: {'id': '6e189d03-298a-49f1-8edc-ee412247810f'} Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 07:10:35.218626 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. Jul 29 07:10:35.219654 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: ERROR nova.api.openstack.wsgi Jul 29 07:10:35.220594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] Returning 404 to user: Instance 6e189d03-298a-49f1-8edc-ee412247810f could not be found. {{(pid=117958) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 07:10:35.220594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-2cd9112a-b358-495c-95dc-8a9a1b8096f9 tempest-AttachVolumeShelveTestJSON-712951082 tempest-AttachVolumeShelveTestJSON-712951082-project] 10.222.0.33 "GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f" status: 404 len: 111 microversion: 2.20 time: 0.037328 Jul 29 07:10:35.220594 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1536/3033] 10.222.0.33 () {60 vars in 1277 bytes} [Fri Jul 29 07:10:35 2022] GET /compute/v2.1/servers/6e189d03-298a-49f1-8edc-ee412247810f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 07:10:40.897062 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-248d5699-f473-4b95-9faa-d2418a00e4d7 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145934c280>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:40.944485 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-248d5699-f473-4b95-9faa-d2418a00e4d7 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/a26e45c6-fa2b-461f-9989-723d8704175d" status: 200 len: 351 microversion: 2.1 time: 0.051137 Jul 29 07:10:40.945116 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1498/3034] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 07:10:40 2022] GET /compute/v2.1/os-volumes/a26e45c6-fa2b-461f-9989-723d8704175d => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:42.270217 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-a9f65c58-6b69-4cee-b3b2-7b08b88082eb tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f1459977e50>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:42.316855 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-a9f65c58-6b69-4cee-b3b2-7b08b88082eb tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/51147af5-fd1d-4f6f-b161-bec0e6f6417c" status: 200 len: 351 microversion: 2.1 time: 0.050304 Jul 29 07:10:42.317410 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1537/3035] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 07:10:42 2022] GET /compute/v2.1/os-volumes/51147af5-fd1d-4f6f-b161-bec0e6f6417c => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:43.644467 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-9b71bc1a-2957-4dc4-98d2-a98809b934a4 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f14594a4160>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:43.690428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-9b71bc1a-2957-4dc4-98d2-a98809b934a4 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4ee9feae-dadc-45c4-8bc7-3ec132cfb73e" status: 200 len: 351 microversion: 2.1 time: 0.050165 Jul 29 07:10:43.690986 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1499/3036] 10.222.0.33 () {58 vars in 1245 bytes} [Fri Jul 29 07:10:43 2022] GET /compute/v2.1/os-volumes/4ee9feae-dadc-45c4-8bc7-3ec132cfb73e => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:43.704129 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-bf5c4b44-d986-4d9d-9381-07d423927237 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145e1cc1f0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:43.785495 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-bf5c4b44-d986-4d9d-9381-07d423927237 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085927 Jul 29 07:10:43.786052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1538/3037] 10.222.0.33 () {58 vars in 1134 bytes} [Fri Jul 29 07:10:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:10:43.799914 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-ce1bc6b8-2249-4a87-acdd-c82f8cd4180e tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145aeb7430>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:43.894866 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-ce1bc6b8-2249-4a87-acdd-c82f8cd4180e tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.098734 Jul 29 07:10:43.895428 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1500/3038] 10.222.0.33 () {58 vars in 1149 bytes} [Fri Jul 29 07:10:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:43.909258 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-18a5207d-c9ef-4a12-89bd-b4ade468be21 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145e1ccee0>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:43.991359 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-18a5207d-c9ef-4a12-89bd-b4ade468be21 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085803 Jul 29 07:10:43.991913 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1539/3039] 10.222.0.33 () {58 vars in 1134 bytes} [Fri Jul 29 07:10:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:10:44.007389 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-535870b3-7d27-4489-8594-f1f7c5caa09a tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145934cdc0>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:44.105368 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-535870b3-7d27-4489-8594-f1f7c5caa09a tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.104074 Jul 29 07:10:44.105931 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1501/3040] 10.222.0.33 () {58 vars in 1167 bytes} [Fri Jul 29 07:10:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:44.119564 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-1db7734c-351c-4e29-b7e0-97e554eb99ed tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f1459a20670>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:44.204337 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-1db7734c-351c-4e29-b7e0-97e554eb99ed tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088754 Jul 29 07:10:44.204966 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1540/3041] 10.222.0.33 () {58 vars in 1170 bytes} [Fri Jul 29 07:10:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:44.222096 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-92413d60-07ad-4e46-9068-d153c103384c tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145e2a3160>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:44.315348 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-92413d60-07ad-4e46-9068-d153c103384c tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.099472 Jul 29 07:10:44.315921 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1502/3042] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Jul 29 07:10:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:10:44.330941 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: DEBUG nova.api.openstack.wsgi [None req-e96db319-b3c7-4af7-b2c4-f1ff52ccb6f1 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145e22da60>' {{(pid=117958) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:44.422052 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO nova.api.openstack.requestlog [None req-e96db319-b3c7-4af7-b2c4-f1ff52ccb6f1 tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094799 Jul 29 07:10:44.422614 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: [pid: 117958|app: 0|req: 1541/3043] 10.222.0.33 () {58 vars in 1188 bytes} [Fri Jul 29 07:10:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 07:10:44.437484 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: DEBUG nova.api.openstack.wsgi [None req-397fc748-3eb5-45d0-98f3-9c8bda5f889b tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] Calling method '.version_select at 0x7f145e2a3e50>' {{(pid=117957) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 07:10:44.532779 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO nova.api.openstack.requestlog [None req-397fc748-3eb5-45d0-98f3-9c8bda5f889b tempest-VolumesTestJSON-798327093 tempest-VolumesTestJSON-798327093-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.099559 Jul 29 07:10:44.533338 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: [pid: 117957|app: 0|req: 1503/3044] 10.222.0.33 () {58 vars in 1155 bytes} [Fri Jul 29 07:10:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 07:11:41.116461 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:11:41.117120 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:11:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:11:58.615430 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:11:58.616020 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:11:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:12:11.461127 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:12:11.461759 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:13:14.508189 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:13:14.508904 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:13:39.656065 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:13:39.656685 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:15:01.124334 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:15:01.125020 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:15:12.879390 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:15:12.880019 dv-cinder-834822-7-iscsi devstack@n-api.service[117957]: Fri Jul 29 07:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:15:18.623069 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:15:18.623616 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:15:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:15:31.470087 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:15:31.470749 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 07:16:34.516013 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 07:16:34.516699 dv-cinder-834822-7-iscsi devstack@n-api.service[117958]: Fri Jul 29 07:16:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!